Jun 23 04:12:44 devstack cinder-volume[82228]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 04:12:44 devstack cinder-volume[82228]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 04:12:44 devstack cinder-volume[82228]: we strongly recommend against using it for new projects. Jun 23 04:12:44 devstack cinder-volume[82228]: If you are already using Eventlet, we recommend migrating to a different Jun 23 04:12:44 devstack cinder-volume[82228]: framework. For more detail see Jun 23 04:12:44 devstack cinder-volume[82228]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 04:12:44 devstack cinder-volume[82228]: import eventlet # noqa Jun 23 04:12:47 devstack cinder-volume[82228]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:12:47 devstack cinder-volume[82228]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:12:47 devstack cinder-volume[82228]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:12:48 devstack cinder-volume[82228]: INFO dbcounter [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Registered counter for database cinder Jun 23 04:12:48 devstack cinder-volume[82228]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:12:48 devstack cinder-volume[82228]: DEBUG dbcounter [-] [82228] Writer thread running {{(pid=82228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 04:12:48 devstack cinder-volume[82228]: INFO cinder.rpc [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 04:12:48 devstack cinder-volume[82228]: INFO cinder.rpc [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 04:12:48 devstack cinder-volume[82228]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:12:49 devstack cinder-volume[82228]: INFO cinder.volume.manager [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Determined volume DB was empty at startup. Jun 23 04:12:49 devstack cinder-volume[82228]: DEBUG cinder.volume.manager [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82228) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 04:12:49 devstack cinder-volume[82228]: INFO cinder.volume.manager [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 04:12:49 devstack cinder-volume[82228]: WARNING stevedore.named [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 04:12:49 devstack cinder-volume[82228]: WARNING castellan.key_manager [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:12:49 devstack cinder-volume[82228]: WARNING cinder.keymgr.conf_key_mgr [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:12:49 devstack cinder-volume[82228]: DEBUG cinder.volume.drivers.lvm [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82228) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 23 04:12:49 devstack cinder-volume[82228]: DEBUG oslo_concurrency.processutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:49 devstack cinder-volume[82228]: DEBUG oslo_concurrency.processutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] CMD "cinder-rtstool verify" returned: 0 in 0.605s {{(pid=82228) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:49 devstack cinder-volume[82228]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:12:49 devstack cinder-volume[82228]: INFO cinder.rpc [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 23 04:12:49 devstack cinder-volume[82228]: INFO cinder.rpc [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 23 04:12:49 devstack cinder-volume[82228]: WARNING stevedore.named [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 04:12:49 devstack cinder-volume[82228]: WARNING castellan.key_manager [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:12:49 devstack cinder-volume[82228]: INFO cinder.volume.manager [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 23 04:12:49 devstack cinder-volume[82228]: DEBUG oslo_db.sqlalchemy.engines [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82228) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:12:50 devstack cinder-volume[82228]: INFO oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Starting 1 workers Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Started child 82430 {{(pid=82228) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Full set of CONF: {{(pid=82228) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] ******************************************************************************** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Configuration options gathered from: {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 04:12:50 devstack cinder-volume[82430]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] ================================================================================ {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] allow_availability_zone_fallback = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] allow_compression_on_image_upload = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] allowed_direct_url_schemes = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] api_rate_limit = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] auth_strategy = keystone {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] az_cache_duration = 3600 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_availability_zone = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_host = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_stats_polling_interval = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backup_api_class = cinder.backup.api.API {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backup_name_template = backup-%s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backup_use_same_host = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backup_use_temp_snapshot = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] chap_password = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] chap_username = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_internal_tenant_project_id = 8bb3cf2968e04cc3953340f13bbadfa9 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_internal_tenant_user_id = f5e6374652554037b90d229f9097941a {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cloned_volume_same_az = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cluster = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] compression_format = gzip {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] compute_api_class = cinder.compute.nova.API {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] config_dir = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] config_source = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] control_exchange = openstack {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] debug = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] default_availability_zone = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] default_group_type = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] default_volume_type = lvmdriver-1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] disk_geometry = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] driver_client_cert = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] driver_client_cert_key = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] driver_data_namespace = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] driver_ssl_cert_path = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] driver_ssl_cert_verify = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] driver_use_ssl = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] enable_force_upload = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] enable_new_services = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] enable_unsupported_driver = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] enforce_multipath_for_image_xfer = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] filter_function = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_api_insecure = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_api_servers = ['http://192.168.122.5/image'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_api_ssl_compression = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_ca_certificates_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_catalog_info = image:glance:publicURL {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_num_retries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance_request_timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] goodness_function = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] graceful_shutdown_timeout = 5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] group_api_class = cinder.group.api.API {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] host = devstack {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_compress_on_upload = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_conversion_address_space_limit = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_conversion_cpu_limit = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_conversion_disable = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_upload_use_cinder_backend = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_upload_use_internal_tenant = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_volume_cache_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_volume_cache_max_count = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] image_volume_cache_max_size_gb = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] init_host_max_objects_retrieval = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] instance_format = [instance: %(uuid)s] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] iscsi_target_flags = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] iscsi_write_cache = on {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] iser_helper = tgtadm {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] iser_ip_address = 192.168.122.5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] iser_port = 3260 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_color = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_config_append = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_dir = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_options = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_rotate_interval = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_rotate_interval_type = days {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] log_rotation_type = none {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] max_age = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82430]: INFO cinder.volume.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] max_logfile_count = 30 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] max_logfile_size_mb = 200 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] max_over_subscription_ratio = 20.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] message_reap_interval = 86400 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] message_ttl = 2592000 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] migration_create_volume_timeout_secs = 300 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] monkey_patch = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] monkey_patch_modules = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] my_ip = 192.168.122.5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] no_snapshot_gb_quota = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] num_iser_scan_tries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] num_shell_tries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] num_volume_device_scan_tries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] nvmeof_conn_info_version = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] nvmet_ns_id = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] nvmet_port_id = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_max_limit = 1000 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_volume_ext_list = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_volume_listen_port = 8776 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_volume_use_ssl = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] osapi_volume_workers = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] per_volume_size_limit = -1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] periodic_fuzzy_delay = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] periodic_interval = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] public_endpoint = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] publish_errors = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_backup_gigabytes = 1000 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_backups = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_gigabytes = 1000 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_groups = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_snapshots = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] quota_volumes = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] rate_limit_burst = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] rate_limit_except_level = CRITICAL {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] rate_limit_interval = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] reinit_driver_count = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] replication_device = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] report_discard_supported = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] report_interval = 120 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] reservation_clean_interval = 86400 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] reservation_expire = 86400 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] reserved_image_namespaces = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] reserved_percentage = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] rpc_response_timeout = 120 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] run_external_periodic_tasks = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] scst_target_driver = iscsi {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] scst_target_iqn_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_down_time = 720 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] shell_completion = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] snapshot_name_template = snapshot-%s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] snapshot_same_host = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] split_loggers = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] state_path = /opt/stack/data/cinder {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] storage_availability_zone = nova {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] storage_protocol = iSCSI {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] syslog_log_facility = LOG_USER {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] target_helper = lioadm {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] target_ip_address = 192.168.122.5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] target_port = 3260 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] target_protocol = iscsi {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] target_secondary_ip_addresses = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] trace_flags = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] transport_url = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] until_refresh = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_chap_auth = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_default_quota_class = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_journal = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_json = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_multipath_for_image_xfer = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_stderr = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] use_syslog = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] verify_glance_signatures = enabled {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_api_class = cinder.volume.api.API {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_backend_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_clear = zero {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_clear_ionice = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_clear_size = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_copy_bps_limit = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_dd_blocksize = 1M {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_name_template = volume-%s {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_service_inithost_offload = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volume_usage_audit_period = month {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] zoning_mode = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_concurrency.disable_process_locking = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.auth_section = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.auth_type = password {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.auth_version = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.cache = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.include_service_catalog = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.insecure = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.interface = public {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_password = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcache_username = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.region_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.service_type = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.5/identity {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.backend = dogpile.cache.null {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.backend_argument = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.backend_expiration_time = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.config_prefix = cache.oslo {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.debug_cache_backend = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.enable_retry_client = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.enable_socket_keepalive = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.expiration_time = 600 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.hashclient_retry_attempts = 2 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_dead_retry = 300 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_pool_maxsize = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_sasl_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.password = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.proxies = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.redis_db = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.redis_server = localhost:6379 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.retry_attempts = 2 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.retry_delay = 0.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.socket_keepalive_count = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.socket_keepalive_idle = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.socket_keepalive_interval = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.socket_timeout = 1.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.tls_allowed_ciphers = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.tls_cafile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.tls_certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.tls_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.tls_keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cache.username = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] coordination.backend_url = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.asyncio_connection = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.asyncio_slave_connection = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.backend = sqlalchemy {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.connection = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.connection_debug = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.connection_parameters = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.connection_recycle_time = 3600 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.connection_trace = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.db_inc_retry_interval = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.db_max_retries = 20 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.db_max_retry_interval = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.db_retry_interval = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.max_overflow = 50 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.max_pool_size = 5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.max_retries = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.mysql_wsrep_sync_wait = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.pool_timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.retry_interval = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.slave_connection = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.sqlite_synchronous = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.synchronous_reader = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] database.use_db_reconnect = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.connection_string = messaging:// {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.es_doc_type = notification {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.es_scroll_size = 10000 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.es_scroll_time = 2m {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.filter_error_trace = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.hmac_keys = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack sudo[82436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.sentinel_service_name = mymaster {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.socket_timeout = 0.1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.trace_requests = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler.trace_sqlalchemy = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler_jaeger.process_tags = {} {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler_jaeger.service_name_prefix = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack sudo[82436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] profiler_otlp.service_name_prefix = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.enforce_new_defaults = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: WARNING oslo_config.cfg [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.enforce_scope = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.policy_default_rule = default {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.policy_file = policy.yaml {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.group = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.helper_command = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] privsep_osbrick.user = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.group = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.helper_command = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] cinder_sys_admin.user = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.auth_section = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.auth_type = password {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.cafile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.collect_timing = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.insecure = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.send_service_user_token = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.split_loggers = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] service_user.timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.auth_section = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.auth_type = password {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.collect_timing = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.insecure = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.region_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.split_loggers = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] glance.timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.backend_availability_zone = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.chap_password = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.chap_username = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.disk_geometry = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.driver_client_cert = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.driver_client_cert_key = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.driver_data_namespace = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.driver_use_ssl = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.extra_capabilities = {} {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.filter_function = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.goodness_function = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.iscsi_target_flags = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.iscsi_write_cache = on {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.iser_helper = tgtadm {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.iser_ip_address = 192.168.122.5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.iser_port = 3260 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.lvm_share_target = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.lvm_type = auto {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.num_shell_tries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.replication_device = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.report_discard_supported = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.reserved_percentage = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.target_helper = tgtadm {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.target_ip_address = 192.168.122.5 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.target_port = 3260 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.target_protocol = iscsi {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.trace_flags = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.unique_fqdn_network = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.use_chap_auth = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_backend_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_clear = zero {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_clear_ionice = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_clear_size = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_reports.file_event_handler = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_reports.log_dir = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.backend_host = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.chap_password = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.chap_username = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.disk_geometry = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.driver_client_cert = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.extra_capabilities = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.filter_function = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.goodness_function = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.iser_helper = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.iser_ip_address = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.iser_port = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.lvm_share_target = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.lvm_type = auto {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.num_shell_tries = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.replication_device = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.report_discard_supported = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.reserved_percentage = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.scst_target_driver = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.storage_protocol = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.target_helper = lioadm {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.target_ip_address = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.target_port = 3260 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.trace_flags = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.use_chap_auth = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_clear = zero {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_clear_size = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] lvmdriver-1.volumes_dir = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_notifications.driver = [] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_notifications.retry = -1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] key_manager.fixed_key = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.barbican_api_version = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.barbican_endpoint = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.barbican_endpoint_type = public {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.barbican_region_name = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.cafile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.collect_timing = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.insecure = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.number_of_retries = 60 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.retry_delay = 1 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.send_service_user_token = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.split_loggers = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.verify_ssl = True {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican.verify_ssl_path = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.auth_section = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.auth_type = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.cafile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.certfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.collect_timing = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.insecure = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.keyfile = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.split_loggers = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] barbican_service_user.timeout = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.approle_role_id = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.approle_secret_id = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.kv_mountpoint = secret {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.kv_path = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.kv_version = 2 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.namespace = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.root_token_id = **** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.ssl_ca_crt_file = None {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.timeout = 60.0 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.use_ssl = False {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:12:50 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] ******************************************************************************** {{(pid=82228) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 04:12:50 devstack sudo[82436]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:50 devstack sudo[82708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:12:50 devstack sudo[82708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:51 devstack sudo[82708]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:51 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.664s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:51 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:12:51 devstack cinder-volume[82430]: INFO cinder.brick.local_dev.lvm [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 23 04:12:51 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:51 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:51 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:51 devstack sudo[82921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:12:51 devstack sudo[82921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:52 devstack sudo[82921]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:52 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.794s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:52 devstack cinder-volume[82430]: DEBUG cinder.brick.local_dev.lvm [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82430) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 23 04:12:52 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:52 devstack sudo[83080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:12:52 devstack sudo[83080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:53 devstack sudo[83080]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:53 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.050s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:53 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:53 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:53 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:53 devstack sudo[83210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:12:53 devstack sudo[83210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:54 devstack sudo[83210]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:54 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.722s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:54 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:54 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:54 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:54 devstack sudo[83216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 23 04:12:54 devstack sudo[83216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:54 devstack sudo[83216]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:54 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.791s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:54 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:54 devstack sudo[83228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:12:54 devstack sudo[83228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:55 devstack sudo[83228]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:55 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.761s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:55 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:55 devstack sudo[83231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:12:55 devstack sudo[83231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:56 devstack sudo[83231]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:56 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:56 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:56 devstack sudo[83237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:12:56 devstack sudo[83237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:57 devstack sudo[83237]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:57 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.842s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:57 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:57 devstack sudo[83242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:12:57 devstack sudo[83242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:58 devstack sudo[83242]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.773s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:58 devstack sudo[83258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:12:58 devstack sudo[83258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:58 devstack sudo[83258]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.827s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:58 devstack cinder-volume[82430]: INFO cinder.volume.drivers.lvm [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:58 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:58 devstack sudo[83373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:12:58 devstack sudo[83373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:59 devstack sudo[83373]: pam_unix(sudo:session): session closed for user root Jun 23 04:12:59 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.639s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:12:59 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:12:59 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:12:59 devstack sudo[83513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:12:59 devstack sudo[83513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:12:59 devstack cinder-volume[82228]: DEBUG dbcounter [-] [82228] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82228) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:13:00 devstack sudo[83513]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:00 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:00 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:00 devstack sudo[83517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:13:00 devstack sudo[83517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:00 devstack sudo[83517]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:00 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:00 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:00 devstack sudo[83521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:13:00 devstack sudo[83521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:01 devstack sudo[83521]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:01 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:01 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:01 devstack sudo[83527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:13:01 devstack sudo[83527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:02 devstack sudo[83527]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:02 devstack cinder-volume[82430]: INFO cinder.volume.driver [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Driver hasn't implemented _init_vendor_properties() Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG cinder.volume.driver [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82430) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG oslo_db.sqlalchemy.engines [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writer thread running {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG cinder.db.api [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Building query based on filter {{(pid=82430) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG cinder.image.image_utils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82430) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 04:13:02 devstack cinder-volume[82430]: INFO cinder.keymgr.migration [None req-dbb79a02-04eb-4fda-a595-59a186669880 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:13:02 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:02 devstack sudo[83531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:13:02 devstack sudo[83531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:03 devstack sudo[83531]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:03 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:03 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:03 devstack sudo[83535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:13:03 devstack sudo[83535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:03 devstack sudo[83535]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:03 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:03 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:03 devstack sudo[83538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:13:03 devstack sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:04 devstack sudo[83538]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:04 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.706s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:04 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:04 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:13:04 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:05 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG cinder.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Notifying Schedulers of capabilities ... {{(pid=82430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:13:05 devstack cinder-volume[82430]: INFO cinder.volume.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Driver initialization completed successfully. Jun 23 04:13:05 devstack cinder-volume[82430]: INFO cinder.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Initiating service 2 cleanup Jun 23 04:13:05 devstack cinder-volume[82430]: INFO cinder.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Service 2 cleanup completed. Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG cinder.service [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Creating RPC server for service cinder-volume {{(pid=82430) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG cinder.service [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82430) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 04:13:05 devstack cinder-volume[82430]: INFO cinder.volume.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:05 devstack sudo[83549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:13:05 devstack sudo[83549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:05 devstack sudo[83549]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:05 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:05 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:13:05 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:06 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:06 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:06 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:06 devstack sudo[83609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:13:06 devstack sudo[83609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:07 devstack sudo[83609]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:13:07 devstack sudo[83613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:13:07 devstack sudo[83613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:13:07 devstack sudo[83613]: pam_unix(sudo:session): session closed for user root Jun 23 04:13:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:13:07 devstack cinder-volume[82430]: INFO cinder.volume.manager [None req-ca739557-f5e0-4432-83bd-bf29520b203f None None] Driver post RPC initialization completed successfully. Jun 23 04:13:07 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager._thread_info {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:13:07 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread count: 6 {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:13:07 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread info: [<_MainThread(MainThread, started 139338636767360)>, , , , , ] {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:13:12 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:13:17 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:14:07 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:14:07 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:14:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:14:07 devstack sudo[85363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:14:07 devstack sudo[85363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:14:08 devstack sudo[85363]: pam_unix(sudo:session): session closed for user root Jun 23 04:14:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.627s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:14:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:14:08 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:14:08 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:14:09 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Jun 23 04:14:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:14:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:14:09 devstack sudo[85369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:14:09 devstack sudo[85369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:14:09 devstack sudo[85369]: pam_unix(sudo:session): session closed for user root Jun 23 04:14:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.600s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:14:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:14:09 devstack sudo[85372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:14:09 devstack sudo[85372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:14:10 devstack sudo[85372]: pam_unix(sudo:session): session closed for user root Jun 23 04:14:10 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:14:10 devstack cinder-volume[82430]: DEBUG cinder.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Notifying Schedulers of capabilities ... {{(pid=82430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:14:10 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager._thread_info {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:14:10 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread count: 6 {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:14:10 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread info: [<_MainThread(MainThread, started 139338636767360)>, , , , , ] {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:15:07 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:15:07 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:15:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:15:07 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:15:07 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:15:08 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Jun 23 04:15:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:15:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:15:08 devstack sudo[88660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:15:08 devstack sudo[88660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:15:09 devstack sudo[88660]: pam_unix(sudo:session): session closed for user root Jun 23 04:15:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:15:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:15:09 devstack sudo[88673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:15:09 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:15:09 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root Jun 23 04:15:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:15:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:15:09 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:15:09 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:15:10 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Jun 23 04:15:10 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:15:10 devstack cinder-volume[82430]: DEBUG cinder.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Notifying Schedulers of capabilities ... {{(pid=82430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:15:10 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager._thread_info {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:15:10 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread count: 6 {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:15:10 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread info: [<_MainThread(MainThread, started 139338636767360)>, , , , , ] {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:15:17 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writing DB stats cinder:SELECT=1 {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:15:17 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writing DB stats cinder:UPDATE=1 {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:16:07 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:16:07 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:16:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:16:07 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:16:07 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:16:08 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Jun 23 04:16:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:16:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:16:08 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:16:08 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:16:09 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Jun 23 04:16:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:16:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:16:09 devstack sudo[90270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:16:09 devstack sudo[90270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:16:09 devstack sudo[90270]: pam_unix(sudo:session): session closed for user root Jun 23 04:16:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:16:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:16:09 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:16:09 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:16:10 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Jun 23 04:16:10 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.663s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:16:10 devstack cinder-volume[82430]: DEBUG cinder.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Notifying Schedulers of capabilities ... {{(pid=82430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:17:07 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:17:07 devstack cinder-volume[82430]: DEBUG cinder.volume.drivers.lvm [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Updating volume stats {{(pid=82430) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 23 04:17:07 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:07 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 23 04:17:07 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:08 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.619s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:08 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:08 devstack sudo[91521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:17:08 devstack sudo[91521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:09 devstack sudo[91521]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:09 devstack sudo[91539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 23 04:17:09 devstack sudo[91539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:09 devstack sudo[91539]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:09 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:09 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 23 04:17:09 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:10 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:10 devstack cinder-volume[82430]: DEBUG oslo_concurrency.processutils [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=82430) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:10 devstack cinder-volume[82430]: DEBUG cinder.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Notifying Schedulers of capabilities ... {{(pid=82430) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:17:10 devstack cinder-volume[82430]: DEBUG oslo_service.periodic_task [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] Running periodic task VolumeManager._thread_info {{(pid=82430) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:17:10 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread count: 6 {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:17:10 devstack cinder-volume[82430]: DEBUG cinder.volume.manager [None req-bb94c8af-85ec-4801-b810-bddf58dbfbcc None None] thread info: [<_MainThread(MainThread, started 139338636767360)>, , , , , ] {{(pid=82430) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:17:17 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writing DB stats cinder:SELECT=1 {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:17:17 devstack cinder-volume[82430]: DEBUG dbcounter [-] [82430] Writing DB stats cinder:UPDATE=1 {{(pid=82430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:17:49 devstack cinder-volume[82228]: INFO oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Caught SIGTERM, stopping children Jun 23 04:17:49 devstack cinder-volume[82228]: DEBUG oslo_concurrency.lockutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Acquiring lock "singleton_lock" {{(pid=82228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:17:49 devstack cinder-volume[82228]: DEBUG oslo_concurrency.lockutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Acquired lock "singleton_lock" {{(pid=82228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:17:49 devstack cinder-volume[82228]: DEBUG oslo_concurrency.lockutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Releasing lock "singleton_lock" {{(pid=82228) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:17:49 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Stop services. {{(pid=82228) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 04:17:49 devstack cinder-volume[82228]: DEBUG oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Killing children. {{(pid=82228) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 04:17:49 devstack cinder-volume[82228]: INFO oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Waiting on 1 children to exit Jun 23 04:17:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.lockutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Acquiring lock "singleton_lock" {{(pid=82430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:17:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.lockutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Acquired lock "singleton_lock" {{(pid=82430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:17:50 devstack cinder-volume[82430]: DEBUG oslo_concurrency.lockutils [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Releasing lock "singleton_lock" {{(pid=82430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:17:50 devstack cinder-volume[82430]: WARNING amqp [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 04:17:50 devstack cinder-volume[82430]: WARNING amqp [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 04:17:50 devstack cinder-volume[82228]: INFO oslo_service.backend._eventlet.service [None req-6a0e67aa-c310-46f5-abe0-732873fd6915 None None] Child 82430 exited with status 0 Jun 23 04:17:50 devstack cinder-volume[92527]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 04:17:50 devstack cinder-volume[92527]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 04:17:50 devstack cinder-volume[92527]: we strongly recommend against using it for new projects. Jun 23 04:17:50 devstack cinder-volume[92527]: If you are already using Eventlet, we recommend migrating to a different Jun 23 04:17:50 devstack cinder-volume[92527]: framework. For more detail see Jun 23 04:17:50 devstack cinder-volume[92527]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 04:17:50 devstack cinder-volume[92527]: import eventlet # noqa Jun 23 04:17:52 devstack cinder-volume[92527]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:17:52 devstack cinder-volume[92527]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:17:52 devstack cinder-volume[92527]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:17:53 devstack cinder-volume[92527]: INFO dbcounter [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Registered counter for database cinder Jun 23 04:17:53 devstack cinder-volume[92527]: DEBUG oslo_db.sqlalchemy.engines [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:17:53 devstack cinder-volume[92527]: DEBUG dbcounter [-] [92527] Writer thread running {{(pid=92527) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 04:17:53 devstack cinder-volume[92527]: INFO cinder.rpc [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 04:17:53 devstack cinder-volume[92527]: INFO cinder.rpc [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 04:17:53 devstack cinder-volume[92527]: DEBUG oslo_db.sqlalchemy.engines [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:17:53 devstack cinder-volume[92527]: INFO cinder.volume.manager [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Determined volume DB was empty at startup. Jun 23 04:17:53 devstack cinder-volume[92527]: DEBUG cinder.volume.manager [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92527) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 04:17:53 devstack cinder-volume[92527]: INFO cinder.volume.manager [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 23 04:17:53 devstack cinder-volume[92527]: WARNING stevedore.named [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 04:17:53 devstack cinder-volume[92527]: WARNING castellan.key_manager [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:17:53 devstack cinder-volume[92527]: WARNING cinder.keymgr.conf_key_mgr [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:17:54 devstack cinder-volume[92527]: INFO cinder.volume.manager [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_db.sqlalchemy.engines [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92527) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:17:54 devstack cinder-volume[92527]: INFO oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Starting 1 workers Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Started child 92743 {{(pid=92527) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Full set of CONF: {{(pid=92527) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] ******************************************************************************** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Configuration options gathered from: {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] ================================================================================ {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] allow_availability_zone_fallback = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] allow_compression_on_image_upload = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] allowed_direct_url_schemes = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] api_rate_limit = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] auth_strategy = keystone {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_availability_zone = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_host = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_stats_polling_interval = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backup_api_class = cinder.backup.api.API {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backup_name_template = backup-%s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backup_use_same_host = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backup_use_temp_snapshot = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92743]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] chap_password = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] chap_username = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_internal_tenant_project_id = 8bb3cf2968e04cc3953340f13bbadfa9 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_internal_tenant_user_id = f5e6374652554037b90d229f9097941a {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cluster = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] compression_format = gzip {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] compute_api_class = cinder.compute.nova.API {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] config_dir = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] config_source = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] control_exchange = openstack {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] debug = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] default_availability_zone = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] default_group_type = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] default_volume_type = QuobyteHD {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] disk_geometry = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] driver_client_cert = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] driver_client_cert_key = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] driver_data_namespace = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] driver_ssl_cert_path = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] driver_ssl_cert_verify = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] driver_use_ssl = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] enable_new_services = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] enable_unsupported_driver = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] enabled_backends = ['QuobyteHD'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] enforce_multipath_for_image_xfer = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] filter_function = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_api_insecure = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_api_servers = ['http://192.168.122.5/image'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_api_ssl_compression = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_ca_certificates_file = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_catalog_info = image:glance:publicURL {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_num_retries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance_request_timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] goodness_function = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] graceful_shutdown_timeout = 5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] group_api_class = cinder.group.api.API {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] host = devstack {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_compress_on_upload = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_conversion_address_space_limit = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_conversion_cpu_limit = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_conversion_disable = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_upload_use_cinder_backend = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_upload_use_internal_tenant = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_volume_cache_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_volume_cache_max_count = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] image_volume_cache_max_size_gb = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] init_host_max_objects_retrieval = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] instance_format = [instance: %(uuid)s] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] iscsi_target_flags = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] iscsi_write_cache = on {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] iser_helper = tgtadm {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] iser_ip_address = 192.168.122.5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] iser_port = 3260 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_color = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_config_append = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_dir = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_file = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_options = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_rotate_interval = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_rotate_interval_type = days {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] log_rotation_type = none {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] max_age = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] max_logfile_count = 30 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] max_logfile_size_mb = 200 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] max_over_subscription_ratio = 20.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] message_reap_interval = 86400 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] message_ttl = 2592000 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] migration_create_volume_timeout_secs = 300 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] monkey_patch = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] monkey_patch_modules = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] my_ip = 192.168.122.5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] no_snapshot_gb_quota = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] num_iser_scan_tries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] num_shell_tries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] num_volume_device_scan_tries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] nvmeof_conn_info_version = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] nvmet_ns_id = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] nvmet_port_id = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_max_limit = 1000 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_volume_ext_list = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_volume_listen_port = 8776 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_volume_use_ssl = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] osapi_volume_workers = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] per_volume_size_limit = -1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] periodic_fuzzy_delay = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] periodic_interval = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] public_endpoint = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] publish_errors = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_backup_gigabytes = 1000 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_backups = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_gigabytes = 1000 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_groups = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_snapshots = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] quota_volumes = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] rate_limit_burst = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] rate_limit_except_level = CRITICAL {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] rate_limit_interval = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] reinit_driver_count = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] replication_device = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] report_discard_supported = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] report_interval = 120 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] reservation_clean_interval = 86400 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] reservation_expire = 86400 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] reserved_image_namespaces = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] reserved_percentage = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] rpc_response_timeout = 120 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] run_external_periodic_tasks = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] scst_target_driver = iscsi {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] scst_target_iqn_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_down_time = 720 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] shell_completion = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] snapshot_name_template = snapshot-%s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] split_loggers = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] state_path = /opt/stack/data/cinder {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] storage_availability_zone = nova {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] storage_protocol = iSCSI {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] syslog_log_facility = LOG_USER {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] target_helper = lioadm {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92743]: INFO cinder.volume.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.remotefs [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=92743) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] target_ip_address = 192.168.122.5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] target_port = 3260 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] target_protocol = iscsi {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] target_secondary_ip_addresses = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] trace_flags = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] transport_url = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] until_refresh = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_chap_auth = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_default_quota_class = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_journal = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_json = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_multipath_for_image_xfer = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_stderr = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] use_syslog = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] verify_glance_signatures = enabled {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_api_class = cinder.volume.api.API {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_backend_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_clear = zero {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_clear_ionice = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_clear_size = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_copy_bps_limit = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_dd_blocksize = 1M {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_name_template = volume-%s {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_service_inithost_offload = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volume_usage_audit_period = month {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] zoning_mode = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_concurrency.disable_process_locking = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.auth_section = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.auth_type = password {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.auth_version = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.cache = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.include_service_catalog = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.insecure = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.interface = public {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_password = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcache_username = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.region_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.service_type = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.5/identity {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.backend = dogpile.cache.null {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.backend_argument = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.backend_expiration_time = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.config_prefix = cache.oslo {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.debug_cache_backend = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.enable_retry_client = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.enable_socket_keepalive = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.expiration_time = 600 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.hashclient_retry_attempts = 2 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_dead_retry = 300 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_pool_maxsize = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_sasl_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.password = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.proxies = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.redis_db = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.redis_server = localhost:6379 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.retry_attempts = 2 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.retry_delay = 0.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.socket_keepalive_count = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.socket_keepalive_idle = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.socket_keepalive_interval = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.socket_timeout = 1.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.tls_allowed_ciphers = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.tls_cafile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.tls_certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.tls_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.tls_keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cache.username = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] coordination.backend_url = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.asyncio_connection = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.asyncio_slave_connection = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.backend = sqlalchemy {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.connection = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.connection_debug = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.connection_parameters = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.connection_recycle_time = 3600 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.connection_trace = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.db_inc_retry_interval = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.db_max_retries = 20 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.db_max_retry_interval = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.db_retry_interval = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.max_overflow = 50 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.max_pool_size = 5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.max_retries = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.mysql_wsrep_sync_wait = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.pool_timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.retry_interval = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.slave_connection = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.sqlite_synchronous = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.synchronous_reader = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] database.use_db_reconnect = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.connection_string = messaging:// {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.es_doc_type = notification {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.es_scroll_size = 10000 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.es_scroll_time = 2m {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.filter_error_trace = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.hmac_keys = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.sentinel_service_name = mymaster {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.socket_timeout = 0.1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.trace_requests = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler.trace_sqlalchemy = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler_jaeger.process_tags = {} {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler_jaeger.service_name_prefix = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] profiler_otlp.service_name_prefix = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.enforce_new_defaults = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: WARNING oslo_config.cfg [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.enforce_scope = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.policy_default_rule = default {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.policy_file = policy.yaml {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.group = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.helper_command = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] privsep_osbrick.user = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.group = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.helper_command = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] cinder_sys_admin.user = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.auth_section = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.auth_type = password {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.cafile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.collect_timing = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.insecure = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.send_service_user_token = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.split_loggers = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] service_user.timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.auth_section = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.auth_type = password {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.collect_timing = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.insecure = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.region_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.split_loggers = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] glance.timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.backend_availability_zone = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.chap_password = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.chap_username = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.disk_geometry = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.driver_client_cert = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.driver_client_cert_key = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.driver_data_namespace = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.driver_use_ssl = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.extra_capabilities = {} {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.filter_function = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.goodness_function = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.iscsi_target_flags = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.iscsi_write_cache = on {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.iser_helper = tgtadm {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.iser_ip_address = 192.168.122.5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.iser_port = 3260 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_host = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_login = admin {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_mount_options = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_password = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_private_key = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_share_path = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.num_shell_tries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.quobyte_volume_url = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=92743) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 04:17:54 devstack cinder-volume[92743]: WARNING cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.replication_device = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.report_discard_supported = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.reserved_percentage = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.target_helper = tgtadm {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.target_ip_address = 192.168.122.5 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.target_port = 3260 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.target_protocol = iscsi {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.trace_flags = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.unique_fqdn_network = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92743]: WARNING cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.use_chap_auth = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_backend_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_clear = zero {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Running cmd (subprocess): mount.quobyte {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_clear_ionice = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_clear_size = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_reports.file_event_handler = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_reports.log_dir = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.backend_availability_zone = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.backend_host = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.chap_password = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.chap_username = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.chiscsi_conf = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.disk_geometry = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.driver_client_cert = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.driver_data_namespace = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.driver_use_ssl = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.extra_capabilities = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.filter_function = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.goodness_function = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.iser_helper = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.iser_ip_address = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.iser_port = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.iser_target_prefix = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_host = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_login = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_mount_options = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_password = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_private_key = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_share_path = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_ssh_port = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.num_shell_tries = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.nvmet_port_id = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.replication_device = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.report_discard_supported = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.reserved_percentage = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.scst_target_driver = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.storage_protocol = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.target_helper = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.target_ip_address = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.target_port = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.target_prefix = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.target_protocol = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.trace_flags = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.use_chap_auth = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_clear = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_clear_size = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] QuobyteHD.volumes_dir = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_notifications.driver = [] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_notifications.retry = -1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] key_manager.fixed_key = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.barbican_api_version = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.barbican_endpoint = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.barbican_endpoint_type = public {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.barbican_region_name = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.cafile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.collect_timing = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.insecure = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.number_of_retries = 60 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.retry_delay = 1 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.send_service_user_token = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack quobyte-client[92748]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 04:17:54 devstack quobyte-client[92748]: Invalid parameters found, error: missing mount point. Jun 23 04:17:54 devstack quobyte-client[92748]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 04:17:54 devstack quobyte-client[92748]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.split_loggers = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=92743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.verify_ssl = True {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92743]: INFO cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 ... Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican.verify_ssl_path = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 -c /etc/quobyte/client-cinder.cfg {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.auth_section = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.auth_type = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.cafile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.certfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.collect_timing = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.insecure = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.keyfile = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.split_loggers = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] barbican_service_user.timeout = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.approle_role_id = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.approle_secret_id = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.kv_mountpoint = secret {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.kv_path = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.kv_version = 2 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.namespace = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.root_token_id = **** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.ssl_ca_crt_file = None {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.timeout = 60.0 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.use_ssl = False {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:17:54 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] ******************************************************************************** {{(pid=92527) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 04:17:54 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 -c /etc/quobyte/client-cinder.cfg Jun 23 04:17:54 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:55 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.767s {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:55 devstack cinder-volume[92743]: INFO cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 succeeded Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=92743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.779s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:55 devstack sudo[92818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:17:55 devstack sudo[92818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:55 devstack sudo[92818]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.628s {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:55 devstack cinder-volume[92743]: INFO cinder.volume.driver [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Driver hasn't implemented _init_vendor_properties() Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG cinder.volume.driver [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=92743) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_db.sqlalchemy.engines [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92743) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG dbcounter [-] [92743] Writer thread running {{(pid=92743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG cinder.db.api [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Building query based on filter {{(pid=92743) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG cinder.image.image_utils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=92743) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 04:17:55 devstack cinder-volume[92743]: INFO cinder.keymgr.migration [None req-65372cf5-0418-4922-93f7-2d6dd3bdacaa None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=92743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=92743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:17:55 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:55 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:17:55 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:56 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.610s {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG cinder.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Notifying Schedulers of capabilities ... {{(pid=92743) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:17:56 devstack cinder-volume[92743]: INFO cinder.volume.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Driver initialization completed successfully. Jun 23 04:17:56 devstack cinder-volume[92743]: INFO cinder.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Initiating service 3 cleanup Jun 23 04:17:56 devstack cinder-volume[92743]: INFO cinder.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Service 3 cleanup completed. Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG cinder.service [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Creating RPC server for service cinder-volume {{(pid=92743) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG cinder.service [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=92743) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 04:17:56 devstack cinder-volume[92743]: INFO cinder.volume.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=92743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=92743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:17:56 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:17:56 devstack sudo[92829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:17:56 devstack sudo[92829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:17:57 devstack sudo[92829]: pam_unix(sudo:session): session closed for user root Jun 23 04:17:57 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.740s {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:17:57 devstack cinder-volume[92743]: INFO cinder.volume.manager [None req-6ab5b03b-ae78-4730-9edf-e73b56ccca4a None None] Driver post RPC initialization completed successfully. Jun 23 04:18:01 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:18:01 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:18:01 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=92743) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:18:01 devstack cinder-volume[92743]: DEBUG cinder.volume.drivers.quobyte [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=92743) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:18:01 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=92743) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:18:01 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:18:01 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:18:01 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:18:02 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Jun 23 04:18:02 devstack cinder-volume[92743]: DEBUG oslo_concurrency.processutils [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.608s {{(pid=92743) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:18:02 devstack cinder-volume[92743]: DEBUG cinder.manager [None req-4f02af55-3738-4fa5-a728-32ff56298b70 None None] Notifying Schedulers of capabilities ... {{(pid=92743) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:18:03 devstack cinder-volume[92527]: INFO oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Caught SIGTERM, stopping children Jun 23 04:18:03 devstack cinder-volume[92527]: DEBUG oslo_concurrency.lockutils [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Acquiring lock "singleton_lock" {{(pid=92527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:18:03 devstack cinder-volume[92527]: DEBUG oslo_concurrency.lockutils [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Acquired lock "singleton_lock" {{(pid=92527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:18:03 devstack cinder-volume[92527]: DEBUG oslo_concurrency.lockutils [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Releasing lock "singleton_lock" {{(pid=92527) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:18:03 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Stop services. {{(pid=92527) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 23 04:18:03 devstack cinder-volume[92527]: DEBUG oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Killing children. {{(pid=92527) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 23 04:18:03 devstack cinder-volume[92527]: INFO oslo_service.backend._eventlet.service [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Waiting on 1 children to exit Jun 23 04:18:07 devstack cinder-volume[92743]: DEBUG dbcounter [-] [92743] Writing DB stats cinder:SELECT=3 {{(pid=92743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:18:07 devstack cinder-volume[92743]: DEBUG dbcounter [-] [92743] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=92743) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:18:08 devstack cinder-volume[92743]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 23 04:18:09 devstack cinder-volume[93036]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 23 04:18:09 devstack cinder-volume[93036]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 04:18:09 devstack cinder-volume[93036]: we strongly recommend against using it for new projects. Jun 23 04:18:09 devstack cinder-volume[93036]: If you are already using Eventlet, we recommend migrating to a different Jun 23 04:18:09 devstack cinder-volume[93036]: framework. For more detail see Jun 23 04:18:09 devstack cinder-volume[93036]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 04:18:09 devstack cinder-volume[93036]: import eventlet # noqa Jun 23 04:18:10 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Acquiring lock "singleton_lock" {{(pid=92743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:18:10 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Acquired lock "singleton_lock" {{(pid=92743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:18:10 devstack cinder-volume[92743]: DEBUG oslo_concurrency.lockutils [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Releasing lock "singleton_lock" {{(pid=92743) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:18:10 devstack cinder-volume[92743]: WARNING amqp [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 04:18:10 devstack cinder-volume[92743]: WARNING amqp [None req-d52e3fd8-88d1-4594-a129-538cb75689e2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 23 04:18:11 devstack cinder-volume[93036]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 23 04:18:11 devstack cinder-volume[93036]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 23 04:18:11 devstack cinder-volume[93036]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93036) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 23 04:18:12 devstack cinder-volume[93036]: INFO dbcounter [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Registered counter for database cinder Jun 23 04:18:12 devstack cinder-volume[93036]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:18:12 devstack cinder-volume[93036]: DEBUG dbcounter [-] [93036] Writer thread running {{(pid=93036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 04:18:12 devstack cinder-volume[93036]: INFO cinder.rpc [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 23 04:18:12 devstack cinder-volume[93036]: INFO cinder.rpc [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 23 04:18:12 devstack cinder-volume[93036]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:18:12 devstack cinder-volume[93036]: INFO cinder.volume.manager [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Determined volume DB was empty at startup. Jun 23 04:18:12 devstack cinder-volume[93036]: DEBUG cinder.volume.manager [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93036) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 23 04:18:12 devstack cinder-volume[93036]: WARNING stevedore.named [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 23 04:18:12 devstack cinder-volume[93036]: WARNING castellan.key_manager [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:18:12 devstack cinder-volume[93036]: WARNING cinder.keymgr.conf_key_mgr [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 23 04:18:13 devstack cinder-volume[93036]: INFO cinder.volume.manager [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_db.sqlalchemy.engines [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93036) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:18:13 devstack cinder-volume[93036]: INFO oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Starting 1 workers Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Started child 93326 {{(pid=93036) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Full set of CONF: {{(pid=93036) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] ******************************************************************************** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Configuration options gathered from: {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] ================================================================================ {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] allow_availability_zone_fallback = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] allow_compression_on_image_upload = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] allowed_direct_url_schemes = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] api_rate_limit = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] auth_strategy = keystone {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_availability_zone = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_host = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_stats_polling_interval = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backup_api_class = cinder.backup.api.API {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backup_name_template = backup-%s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backup_use_same_host = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backup_use_temp_snapshot = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] chap_password = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93326]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] chap_username = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_internal_tenant_project_id = 8bb3cf2968e04cc3953340f13bbadfa9 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_internal_tenant_user_id = f5e6374652554037b90d229f9097941a {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cluster = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] compression_format = gzip {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] compute_api_class = cinder.compute.nova.API {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] config_dir = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] config_source = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] control_exchange = openstack {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] debug = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] default_availability_zone = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] default_group_type = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] default_volume_type = QuobyteHD {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] disk_geometry = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] driver_client_cert = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] driver_client_cert_key = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] driver_data_namespace = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] driver_ssl_cert_path = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] driver_ssl_cert_verify = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] driver_use_ssl = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] enable_new_services = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] enable_unsupported_driver = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] enabled_backends = ['QuobyteHD'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] enforce_multipath_for_image_xfer = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] filter_function = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_api_insecure = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_api_servers = ['http://192.168.122.5/image'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_api_ssl_compression = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_ca_certificates_file = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_catalog_info = image:glance:publicURL {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_num_retries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance_request_timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] goodness_function = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] graceful_shutdown_timeout = 5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] group_api_class = cinder.group.api.API {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] host = devstack {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_compress_on_upload = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_conversion_address_space_limit = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_conversion_cpu_limit = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_conversion_disable = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_upload_use_cinder_backend = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_upload_use_internal_tenant = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_volume_cache_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_volume_cache_max_count = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] image_volume_cache_max_size_gb = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] init_host_max_objects_retrieval = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] instance_format = [instance: %(uuid)s] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] iscsi_target_flags = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] iscsi_write_cache = on {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] iser_helper = tgtadm {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] iser_ip_address = 192.168.122.5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] iser_port = 3260 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_color = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_config_append = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_dir = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_file = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_options = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_rotate_interval = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_rotate_interval_type = days {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] log_rotation_type = none {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] max_age = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] max_logfile_count = 30 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] max_logfile_size_mb = 200 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] max_over_subscription_ratio = 20.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] message_reap_interval = 86400 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] message_ttl = 2592000 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] migration_create_volume_timeout_secs = 300 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] monkey_patch = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] monkey_patch_modules = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] my_ip = 192.168.122.5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] no_snapshot_gb_quota = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] num_iser_scan_tries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] num_shell_tries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] num_volume_device_scan_tries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] nvmeof_conn_info_version = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] nvmet_ns_id = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] nvmet_port_id = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_max_limit = 1000 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_volume_ext_list = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_volume_listen_port = 8776 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_volume_use_ssl = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] osapi_volume_workers = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] per_volume_size_limit = -1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] periodic_fuzzy_delay = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] periodic_interval = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] public_endpoint = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] publish_errors = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_backup_gigabytes = 1000 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93326) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_backups = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_gigabytes = 1000 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_groups = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_snapshots = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] quota_volumes = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] rate_limit_burst = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] rate_limit_except_level = CRITICAL {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] rate_limit_interval = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] reinit_driver_count = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] replication_device = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] report_discard_supported = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] report_interval = 120 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] reservation_clean_interval = 86400 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] reservation_expire = 86400 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] reserved_image_namespaces = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] reserved_percentage = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] rpc_response_timeout = 120 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] run_external_periodic_tasks = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] scst_target_driver = iscsi {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] scst_target_iqn_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_down_time = 720 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] shell_completion = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] snapshot_name_template = snapshot-%s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] split_loggers = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] state_path = /opt/stack/data/cinder {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] storage_availability_zone = nova {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] storage_protocol = iSCSI {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] syslog_log_facility = LOG_USER {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] target_helper = lioadm {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] target_ip_address = 192.168.122.5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] target_port = 3260 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] target_protocol = iscsi {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] target_secondary_ip_addresses = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] trace_flags = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] transport_url = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] until_refresh = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_chap_auth = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_default_quota_class = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_journal = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_json = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_multipath_for_image_xfer = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_stderr = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] use_syslog = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] verify_glance_signatures = enabled {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_api_class = cinder.volume.api.API {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_backend_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_clear = zero {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_clear_ionice = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_clear_size = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_copy_bps_limit = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_dd_blocksize = 1M {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_name_template = volume-%s {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_service_inithost_offload = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volume_usage_audit_period = month {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] zoning_mode = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_concurrency.disable_process_locking = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.auth_section = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.auth_type = password {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.auth_version = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.cache = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.include_service_catalog = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.insecure = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.interface = public {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_password = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcache_username = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.region_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.service_type = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.5/identity {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.backend = dogpile.cache.null {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.backend_argument = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.backend_expiration_time = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.config_prefix = cache.oslo {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.debug_cache_backend = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.enable_retry_client = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.enable_socket_keepalive = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.expiration_time = 600 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.hashclient_retry_attempts = 2 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_dead_retry = 300 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_pool_maxsize = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_sasl_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.password = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.proxies = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.redis_db = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.redis_server = localhost:6379 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.retry_attempts = 2 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.retry_delay = 0.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.socket_keepalive_count = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.socket_keepalive_idle = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.socket_keepalive_interval = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.socket_timeout = 1.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.tls_allowed_ciphers = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.tls_cafile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.tls_certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.tls_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.tls_keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cache.username = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] coordination.backend_url = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.asyncio_connection = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.asyncio_slave_connection = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.backend = sqlalchemy {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.connection = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.connection_debug = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.connection_parameters = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.connection_recycle_time = 3600 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.connection_trace = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.db_inc_retry_interval = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.db_max_retries = 20 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.db_max_retry_interval = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.db_retry_interval = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.max_overflow = 50 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93326) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 23 04:18:13 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 23 04:18:13 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.max_pool_size = 5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.max_retries = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Running cmd (subprocess): mount.quobyte {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.mysql_wsrep_sync_wait = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.pool_timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.retry_interval = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.slave_connection = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.sqlite_synchronous = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.synchronous_reader = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] database.use_db_reconnect = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.connection_string = messaging:// {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.es_doc_type = notification {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.es_scroll_size = 10000 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.es_scroll_time = 2m {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.filter_error_trace = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.hmac_keys = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.sentinel_service_name = mymaster {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.socket_timeout = 0.1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.trace_requests = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler.trace_sqlalchemy = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler_jaeger.process_tags = {} {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler_jaeger.service_name_prefix = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] profiler_otlp.service_name_prefix = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.enforce_new_defaults = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: WARNING oslo_config.cfg [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.enforce_scope = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.policy_default_rule = default {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.policy_file = policy.yaml {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.group = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.helper_command = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] privsep_osbrick.user = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.group = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.helper_command = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] cinder_sys_admin.user = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.auth_section = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.auth_type = password {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.cafile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.collect_timing = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.insecure = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.send_service_user_token = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.split_loggers = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] service_user.timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.auth_section = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.auth_type = password {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.collect_timing = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.insecure = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.region_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.split_loggers = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] glance.timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.backend_availability_zone = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.chap_password = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.chap_username = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.disk_geometry = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.driver_client_cert = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.driver_client_cert_key = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.driver_data_namespace = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.driver_use_ssl = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.extra_capabilities = {} {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.filter_function = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.goodness_function = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack quobyte-client[93340]: Reading configuration file: /etc/quobyte/client.cfg Jun 23 04:18:13 devstack quobyte-client[93340]: Invalid parameters found, error: missing mount point. Jun 23 04:18:13 devstack quobyte-client[93340]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.iscsi_target_flags = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.iscsi_write_cache = on {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack quobyte-client[93340]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.iser_helper = tgtadm {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.iser_ip_address = 192.168.122.5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.iser_port = 3260 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_host = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_login = admin {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_mount_options = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_password = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_private_key = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_share_path = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.num_shell_tries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.quobyte_volume_url = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.replication_device = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.report_discard_supported = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.reserved_percentage = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.target_helper = tgtadm {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.target_ip_address = 192.168.122.5 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.target_port = 3260 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.target_protocol = iscsi {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.trace_flags = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.unique_fqdn_network = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.use_chap_auth = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_backend_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_clear = zero {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_clear_ionice = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_clear_size = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_reports.file_event_handler = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_reports.log_dir = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.backend_availability_zone = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.backend_host = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.chap_password = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.chap_username = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.chiscsi_conf = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.disk_geometry = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.driver_client_cert = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.driver_data_namespace = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.driver_use_ssl = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.extra_capabilities = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.filter_function = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.goodness_function = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.iser_helper = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.iser_ip_address = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.iser_port = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.iser_target_prefix = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_host = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_login = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_mount_options = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_password = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_private_key = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_share_path = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_ssh_port = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.num_shell_tries = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.nvmet_port_id = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.replication_device = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.report_discard_supported = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.reserved_percentage = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.scst_target_driver = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.storage_protocol = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.target_helper = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.target_ip_address = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.target_port = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.target_prefix = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.target_protocol = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.trace_flags = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.use_chap_auth = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_clear = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_clear_size = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] QuobyteHD.volumes_dir = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_notifications.driver = [] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_notifications.retry = -1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] key_manager.fixed_key = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.barbican_api_version = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.barbican_endpoint = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.barbican_endpoint_type = public {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.barbican_region_name = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.cafile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.collect_timing = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.insecure = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.number_of_retries = 60 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.retry_delay = 1 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.send_service_user_token = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.split_loggers = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.verify_ssl = True {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican.verify_ssl_path = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.auth_section = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.auth_type = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.cafile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.certfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.collect_timing = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.insecure = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.keyfile = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.split_loggers = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] barbican_service_user.timeout = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.approle_role_id = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.approle_secret_id = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.kv_mountpoint = secret {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.kv_path = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.kv_version = 2 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.namespace = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.root_token_id = **** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.ssl_ca_crt_file = None {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.timeout = 60.0 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.use_ssl = False {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 23 04:18:13 devstack cinder-volume[93036]: DEBUG oslo_service.backend._eventlet.service [None req-f4bd0329-932c-48d5-9832-648e706fd006 None None] ******************************************************************************** {{(pid=93036) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 23 04:18:13 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.643s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:18:13 devstack cinder-volume[93326]: INFO cinder.volume.driver [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Driver hasn't implemented _init_vendor_properties() Jun 23 04:18:13 devstack cinder-volume[93326]: DEBUG cinder.volume.driver [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93326) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_db.sqlalchemy.engines [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93326) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writer thread running {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.db.api [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Building query based on filter {{(pid=93326) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93326) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:18:14 devstack cinder-volume[93326]: INFO cinder.keymgr.migration [None req-6f9162d9-008c-445e-8729-f637c85513ec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 23 04:18:14 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:18:14 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:18:14 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.641s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:18:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Driver initialization completed successfully. Jun 23 04:18:14 devstack cinder-volume[93326]: INFO cinder.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Initiating service 3 cleanup Jun 23 04:18:14 devstack cinder-volume[93326]: INFO cinder.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Service 3 cleanup completed. Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.service [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Creating RPC server for service cinder-volume {{(pid=93326) start /opt/stack/cinder/cinder/service.py:231}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.service [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93326) start /opt/stack/cinder/cinder/service.py:237}} Jun 23 04:18:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:18:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:18:14 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:18:14 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:18:15 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jun 23 04:18:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.638s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:18:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d96d3f51-0132-4860-9586-6de9818b6536 None None] Driver post RPC initialization completed successfully. Jun 23 04:18:23 devstack cinder-volume[93036]: DEBUG dbcounter [-] [93036] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93036) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:18:24 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:18:25 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:18:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:18:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 6 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:18:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:19:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:19:54 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:19:54 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:19:56 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jun 23 04:19:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.656s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:19:56 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:19:56 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:19:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 6 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:19:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:19:57 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:19:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Flow 'volume_create_manager' (75c56c68-6442-4330-b9be-ef6cb80e1568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:19:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc3f9a2-2cbb-4ae8-bce0-57f0bf08b51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7dc3f9a2-2cbb-4ae8-bce0-57f0bf08b51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-919651230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d9b208-d230-4d98-af28-b2210b6a89b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15a7f31dd584273afe31ceea702f031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:19:58Z,use_quota=True,user_id='5a12dba61c6f45168e00003e7980e3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5fd485-ce9b-4a84-8884-60da6e866c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff5fd485-ce9b-4a84-8884-60da6e866c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552afaca-3a5b-4aa4-aa5a-5051bec243e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (552afaca-3a5b-4aa4-aa5a-5051bec243e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d9b208-d230-4d98-af28-b2210b6a89b3', 'volume_name': 'volume-69d9b208-d230-4d98-af28-b2210b6a89b3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e7eea9-9f18-40a9-9c5f-744e1efc75bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3e7eea9-9f18-40a9-9c5f-744e1efc75bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725bbd06-8040-473e-8ebb-fa413e5d7e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:19:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Volume 69d9b208-d230-4d98-af28-b2210b6a89b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d9b208-d230-4d98-af28-b2210b6a89b3', 'volume_size': 1} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-919651230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d9b208-d230-4d98-af28-b2210b6a89b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e15a7f31dd584273afe31ceea702f031',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:19:58Z,use_quota=True,user_id='5a12dba61c6f45168e00003e7980e3e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Creating volume 69d9b208-d230-4d98-af28-b2210b6a89b3 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:19:58 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:19:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:19:58 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 1073741824 Jun 23 04:19:58 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:19:59 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jun 23 04:19:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 1073741824" returned: 0 in 1.278s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:19:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:19:59 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 Jun 23 04:19:59 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:01 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3" returned: 0 in 1.430s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] <== create_volume: return (2817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.829s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (725bbd06-8040-473e-8ebb-fa413e5d7e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d9b208-d230-4d98-af28-b2210b6a89b3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611ec331-8a1c-4332-a22b-594f37eed0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:01 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Volume volume-69d9b208-d230-4d98-af28-b2210b6a89b3 (69d9b208-d230-4d98-af28-b2210b6a89b3): created successfully Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (611ec331-8a1c-4332-a22b-594f37eed0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Flow 'volume_create_manager' (75c56c68-6442-4330-b9be-ef6cb80e1568) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3b5a1ce4-d51e-4213-953e-2506bb74f5ae tempest-VolumesAdminNegativeTest-198135224 None] Created volume successfully. Jun 23 04:20:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Acquiring lock "cinder-69d9b208-d230-4d98-af28-b2210b6a89b3-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:20:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Lock "cinder-69d9b208-d230-4d98-af28-b2210b6a89b3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:20:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Acquiring lock "cinder-quobyte-69d9b208-d230-4d98-af28-b2210b6a89b3" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:20:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Lock "cinder-quobyte-69d9b208-d230-4d98-af28-b2210b6a89b3" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:20:02 devstack cinder-volume[93326]: INFO oslo.privsep.daemon [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnsb1mkh9/privsep.sock'] Jun 23 04:20:02 devstack sudo[94594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnsb1mkh9/privsep.sock Jun 23 04:20:02 devstack sudo[94594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 04:20:03 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: Jun 23 04:20:04 devstack cinder-volume[93326]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 23 04:20:05 devstack sudo[94594]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:05 devstack cinder-volume[93326]: INFO oslo.privsep.daemon [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Spawned new privsep daemon via rootwrap Jun 23 04:20:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Accepted privsep connection to /tmp/tmpnsb1mkh9/privsep.sock {{(pid=93326) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 23 04:20:05 devstack cinder-volume[93326]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 23 04:20:05 devstack cinder-volume[93326]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 23 04:20:05 devstack cinder-volume[93326]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 23 04:20:05 devstack cinder-volume[93326]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94617 Jun 23 04:20:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a140f5-d7c4-407d-bfc7-60823ced61f9]: (2,) {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:20:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca490a-2cff-41bd-ae1e-596cab8fb3e8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:20:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:05 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 Jun 23 04:20:05 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:06 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3" returned: 0 in 0.926s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:06 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3 Jun 23 04:20:06 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:06 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-69d9b208-d230-4d98-af28-b2210b6a89b3" returned: 0 in 0.720s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Lock "cinder-quobyte-69d9b208-d230-4d98-af28-b2210b6a89b3" released by "delete_volume" :: held 3.915s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:20:06 devstack cinder-volume[93326]: WARNING cinder.quota [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:20:06 devstack cinder-volume[93326]: WARNING cinder.quota [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Created reservations ['95351161-42d2-4c5f-8bb9-91bbefaa5855', '42073dbf-b15e-42ae-bd88-6f276b4750de', '55f485cf-b6db-4039-94be-b43569bb2273', 'a2ede559-b260-474c-9add-75ec75ba0db4'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:06 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:20:06 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.645s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:07 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:20:07 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Deleted volume successfully. Jun 23 04:20:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0d39d2af-1eeb-40d1-b0eb-db886bf99eae tempest-VolumesAdminNegativeTest-198135224 None] Lock "cinder-69d9b208-d230-4d98-af28-b2210b6a89b3-delete_volume" released by "delete_volume" :: held 4.842s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Flow 'volume_create_manager' (0e1a4df9-38a1-4494-96d7-aa0e776cd355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd96719-5146-47f3-b2ec-bc211b5ff381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd96719-5146-47f3-b2ec-bc211b5ff381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-971209805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72022aa3-eb73-4d10-bad3-eb808e7f937a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4adf625f6514704b53ac3eee3318ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:20:15Z,use_quota=True,user_id='b24b7a13b0f74b069944c04275649c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b598667f-7a93-49f4-bf63-5f101f7f196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b598667f-7a93-49f4-bf63-5f101f7f196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d5d33c-a715-4cc0-ac62-d9c43da38c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d5d33c-a715-4cc0-ac62-d9c43da38c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72022aa3-eb73-4d10-bad3-eb808e7f937a', 'volume_name': 'volume-72022aa3-eb73-4d10-bad3-eb808e7f937a', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e86ac9-1862-4237-a867-ae37192a65f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e86ac9-1862-4237-a867-ae37192a65f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e672e4-4ba5-4e3f-a922-044e493eb2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Volume 72022aa3-eb73-4d10-bad3-eb808e7f937a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72022aa3-eb73-4d10-bad3-eb808e7f937a', 'volume_size': 1} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-971209805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72022aa3-eb73-4d10-bad3-eb808e7f937a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4adf625f6514704b53ac3eee3318ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:20:15Z,use_quota=True,user_id='b24b7a13b0f74b069944c04275649c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Creating volume 72022aa3-eb73-4d10-bad3-eb808e7f937a {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:20:15 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:20:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:15 devstack sudo[94944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a 1073741824 Jun 23 04:20:15 devstack sudo[94944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Flow 'volume_create_manager' (1f60a9a7-7949-480b-8060-89981d669fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f991ac-728d-433f-99cc-ac28dc73083d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4f991ac-728d-433f-99cc-ac28dc73083d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-502988613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6187e379-6c58-4173-a4f8-d0fb45d8259f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26926b39b7844bef819e432071b57999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:20:16Z,use_quota=True,user_id='4e5e7a89243343d8ab893e76d5f839aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8db76a1-1788-40f7-8e84-093f44197ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8db76a1-1788-40f7-8e84-093f44197ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284e1dbc-752f-4b1e-85a9-bb2af94012e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284e1dbc-752f-4b1e-85a9-bb2af94012e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6187e379-6c58-4173-a4f8-d0fb45d8259f', 'volume_name': 'volume-6187e379-6c58-4173-a4f8-d0fb45d8259f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a925ea-d695-4df2-b7e6-c4c5fabbee61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93a925ea-d695-4df2-b7e6-c4c5fabbee61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c3992b-ab4c-46e5-9865-e483e4b9eb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Volume 6187e379-6c58-4173-a4f8-d0fb45d8259f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6187e379-6c58-4173-a4f8-d0fb45d8259f', 'volume_size': 1} Jun 23 04:20:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:17 devstack sudo[94944]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a 1073741824" returned: 0 in 1.845s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:17 devstack sudo[94952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a Jun 23 04:20:17 devstack sudo[94952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:18 devstack sudo[94952]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a" returned: 0 in 1.433s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] <== create_volume: return (3342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.345s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-502988613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6187e379-6c58-4173-a4f8-d0fb45d8259f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26926b39b7844bef819e432071b57999',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:20:16Z,use_quota=True,user_id='4e5e7a89243343d8ab893e76d5f839aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Creating volume 6187e379-6c58-4173-a4f8-d0fb45d8259f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:20:18 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:18 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e672e4-4ba5-4e3f-a922-044e493eb2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72022aa3-eb73-4d10-bad3-eb808e7f937a', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b357da2-ef2e-492c-9af2-c45f50e9208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:19 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f 1073741824 Jun 23 04:20:19 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:19 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Volume volume-72022aa3-eb73-4d10-bad3-eb808e7f937a (72022aa3-eb73-4d10-bad3-eb808e7f937a): created successfully Jun 23 04:20:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b357da2-ef2e-492c-9af2-c45f50e9208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Flow 'volume_create_manager' (0e1a4df9-38a1-4494-96d7-aa0e776cd355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-98b6e5a7-c7b4-4b2b-b49e-b8dffa6c55af tempest-AttachVolumeNegativeTest-820855793 None] Created volume successfully. Jun 23 04:20:20 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f 1073741824" returned: 0 in 1.362s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:20 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f Jun 23 04:20:20 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:21 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f" returned: 0 in 1.060s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] <== create_volume: return (2556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.563s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1c3992b-ab4c-46e5-9865-e483e4b9eb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6187e379-6c58-4173-a4f8-d0fb45d8259f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b1912f-1a7b-4a69-bd4d-0b5f80d43e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:21 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Volume volume-6187e379-6c58-4173-a4f8-d0fb45d8259f (6187e379-6c58-4173-a4f8-d0fb45d8259f): created successfully Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b1912f-1a7b-4a69-bd4d-0b5f80d43e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Flow 'volume_create_manager' (1f60a9a7-7949-480b-8060-89981d669fc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:21 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1b2ec629-0438-40c5-aa52-aa5f84d35768 tempest-ServerActionsTestOtherA-1894687364 None] Created volume successfully. Jun 23 04:20:28 devstack cinder-volume[93326]: WARNING py.warnings [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 23 04:20:28 devstack cinder-volume[93326]: .first() Jun 23 04:20:28 devstack cinder-volume[93326]: Jun 23 04:20:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d763420-0916-4edb-aac2-6906e35dcc43]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:20:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:28 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a Jun 23 04:20:28 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:29 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a" returned: 0 in 0.907s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.932s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-72022aa3-eb73-4d10-bad3-eb808e7f937a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '58f178a8-42fd-4180-b854-03e4287939e8', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:20:29 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-a9dfffd3-a8c8-4c3c-96ad-8f2de9edc7d7 req-ec2f2ea2-5af6-49df-823a-c2fd1f7eff37 tempest-AttachVolumeNegativeTest-820855793 None] attachment_update completed successfully. Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Flow 'volume_create_manager' (329b02cc-449f-4f2a-98d5-522a3b0353b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be5f775-8269-4fa6-bc6e-47b40d3e1e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be5f775-8269-4fa6-bc6e-47b40d3e1e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1844444164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142f5ad3-8e4f-4871-93ce-5fd10ab6809d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac537f9e232443d282301d9dd1f6325a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:20:39Z,use_quota=True,user_id='b527119a06514f0bacae86c68a31a46a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8767eea-80bf-4b7d-9c6e-558bf721d5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8767eea-80bf-4b7d-9c6e-558bf721d5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38643c40-55fe-49f1-9561-e70cae5e7134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38643c40-55fe-49f1-9561-e70cae5e7134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '142f5ad3-8e4f-4871-93ce-5fd10ab6809d', 'volume_name': 'volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6c2a9d-24ff-4fee-983e-d1e3dc260dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a6c2a9d-24ff-4fee-983e-d1e3dc260dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e6b17b-525e-435e-a8cd-2fe982f1cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:39 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Volume 142f5ad3-8e4f-4871-93ce-5fd10ab6809d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d', 'volume_size': 1} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:20:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1844444164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=142f5ad3-8e4f-4871-93ce-5fd10ab6809d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac537f9e232443d282301d9dd1f6325a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:20:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:20:39Z,use_quota=True,user_id='b527119a06514f0bacae86c68a31a46a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Creating volume 142f5ad3-8e4f-4871-93ce-5fd10ab6809d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:20:39 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:20:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:39 devstack sudo[95605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d 1073741824 Jun 23 04:20:39 devstack sudo[95605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:41 devstack sudo[95605]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d 1073741824" returned: 0 in 1.801s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:41 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d Jun 23 04:20:41 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:42 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d" returned: 0 in 1.496s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] <== create_volume: return (3378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.384s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e6b17b-525e-435e-a8cd-2fe982f1cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45001d3-e92a-4466-bf81-c35f6fff46ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:20:42 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Volume volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d (142f5ad3-8e4f-4871-93ce-5fd10ab6809d): created successfully Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45001d3-e92a-4466-bf81-c35f6fff46ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:20:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Flow 'volume_create_manager' (329b02cc-449f-4f2a-98d5-522a3b0353b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:20:42 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f5599803-0a2b-4efa-90cb-34821737161b tempest-ServerRescueNegativeTestJSON-2052698633 None] Created volume successfully. Jun 23 04:20:52 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:DELETE=2,cinder:INSERT=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:20:52 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=22,cinder:INSERT=5,cinder:UPDATE=21,cinder:DELETE=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:20:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:20:54 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:20:54 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:20:55 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jun 23 04:20:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.176s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:20:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:20:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:20:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 8 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:20:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Acquiring lock "cinder-142f5ad3-8e4f-4871-93ce-5fd10ab6809d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "cinder-142f5ad3-8e4f-4871-93ce-5fd10ab6809d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Acquiring lock "cinder-quobyte-142f5ad3-8e4f-4871-93ce-5fd10ab6809d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "cinder-quobyte-142f5ad3-8e4f-4871-93ce-5fd10ab6809d" acquired by "delete_volume" :: waited 0.039s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[989fdca7-6d3a-4f26-97d9-6e3eaaca5315]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:12 devstack sudo[96070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d Jun 23 04:21:12 devstack sudo[96070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4df970-c6f8-466a-b1b3-49b52ccce297]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:21:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:13 devstack sudo[96081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f Jun 23 04:21:13 devstack sudo[96081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:14 devstack sudo[96070]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d" returned: 0 in 2.009s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:14 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d Jun 23 04:21:14 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:15 devstack sudo[96081]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f" returned: 0 in 2.131s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.177s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-6187e379-6c58-4173-a4f8-d0fb45d8259f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd20ba232-6a2b-479b-a263-03c84c814747', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:21:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-0a308b28-414e-48fc-8994-5c60098912a3 req-945e8d23-b043-4fe8-93f1-3b7032e86a2f tempest-ServerActionsTestOtherA-1894687364 None] attachment_update completed successfully. Jun 23 04:21:16 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-142f5ad3-8e4f-4871-93ce-5fd10ab6809d" returned: 0 in 1.607s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "cinder-quobyte-142f5ad3-8e4f-4871-93ce-5fd10ab6809d" released by "delete_volume" :: held 3.687s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Created reservations ['b5704a79-c4ac-4ef8-a54e-3a973e75fceb', '6ac701e8-16fe-45e0-aa23-19be14a5b41e', '088fab31-0fcf-46d9-974e-f9544c191ce5', '1ad1ed96-1406-4cb5-844f-20b197e27c46'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:16 devstack sudo[96130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:21:16 devstack sudo[96130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:17 devstack sudo[96130]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.179s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:17 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:21:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Deleted volume successfully. Jun 23 04:21:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-55df0705-09e8-4dc2-ba1c-648a81acc7b5 tempest-ServerRescueNegativeTestJSON-2052698633 None] Lock "cinder-142f5ad3-8e4f-4871-93ce-5fd10ab6809d-delete_volume" released by "delete_volume" :: held 5.269s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:21:25 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-0f61b6f4-4104-409d-9c09-0c8aa3456de6 tempest-ServerActionsTestOtherA-1894687364 None] Terminate volume connection completed successfully. Jun 23 04:21:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-0f61b6f4-4104-409d-9c09-0c8aa3456de6 tempest-ServerActionsTestOtherA-1894687364 None] Deleting attachment d20ba232-6a2b-479b-a263-03c84c814747. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:21:27 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=9,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:21:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[149e102f-d3c3-4927-8aa8-7eae1fdc6bfb]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:21:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:29 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f Jun 23 04:21:29 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Flow 'volume_create_manager' (a84ab5f9-486e-4a20-850e-421f82519ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9499ac30-59a6-43a0-818c-3df5b819e0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9499ac30-59a6-43a0-818c-3df5b819e0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-233785477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef6ed54-942c-4a9c-9486-9c3d87d23683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bfb5fa0df154723b4ba9c177c5e8c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:21:29Z,use_quota=True,user_id='cb1bfaa1e2564486b2f933d660c274cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6248f17-f6ad-42fc-8bde-1e57d58692e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6248f17-f6ad-42fc-8bde-1e57d58692e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f8d2c8-0d82-40c6-80d0-4264ed73f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f8d2c8-0d82-40c6-80d0-4264ed73f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ef6ed54-942c-4a9c-9486-9c3d87d23683', 'volume_name': 'volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660facf7-a426-4f4a-b5c1-7a0be3f277e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660facf7-a426-4f4a-b5c1-7a0be3f277e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63fd698-adb0-4bad-967d-6ccc91abb8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:21:29 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Volume 2ef6ed54-942c-4a9c-9486-9c3d87d23683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683', 'volume_size': 1} Jun 23 04:21:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:30 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f" returned: 0 in 1.400s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.501s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.694s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-233785477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ef6ed54-942c-4a9c-9486-9c3d87d23683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bfb5fa0df154723b4ba9c177c5e8c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:21:29Z,use_quota=True,user_id='cb1bfaa1e2564486b2f933d660c274cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Creating volume 2ef6ed54-942c-4a9c-9486-9c3d87d23683 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:21:30 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:30 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 1073741824 Jun 23 04:21:30 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-6187e379-6c58-4173-a4f8-d0fb45d8259f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4b2ee230-21b6-4cd9-a01b-4faee891d7df', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:21:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-463a5725-9c15-449f-a2c9-1dfd6a83c41d req-830eb9dd-d729-4e8a-9f26-5709dff13703 tempest-ServerActionsTestOtherA-1894687364 None] attachment_update completed successfully. Jun 23 04:21:31 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 1073741824" returned: 0 in 1.132s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:31 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 Jun 23 04:21:31 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:32 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683" returned: 0 in 0.826s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f63fd698-adb0-4bad-967d-6ccc91abb8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b22551-cbcb-4f9e-a7ff-9c0fdd2fb9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:21:32 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Volume volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 (2ef6ed54-942c-4a9c-9486-9c3d87d23683): created successfully Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b22551-cbcb-4f9e-a7ff-9c0fdd2fb9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:21:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Flow 'volume_create_manager' (a84ab5f9-486e-4a20-850e-421f82519ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:21:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6efb5ce2-6ca8-4d71-becc-1fa40936ac98 tempest-DeleteServersTestJSON-1990022567 None] Created volume successfully. Jun 23 04:21:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:35 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c7c67c-7c04-4fac-811f-4723ad025a9e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:21:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:36 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 Jun 23 04:21:36 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:36 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683" returned: 0 in 0.991s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.026s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '76018692-1ca3-40cf-a175-9e31597db78f', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:21:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-fbb5a2c8-54ac-4e7b-9c6f-cf71a49162bb req-81a4a736-b045-446e-983f-128aae8b0663 tempest-DeleteServersTestJSON-1990022567 None] attachment_update completed successfully. Jun 23 04:21:45 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-0db4def8-f4f8-447d-af5e-e7eec0835b82 req-1310bc42-48ba-4620-be34-95de222ed9c6 tempest-AttachVolumeNegativeTest-820855793 None] Terminate volume connection completed successfully. Jun 23 04:21:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-0db4def8-f4f8-447d-af5e-e7eec0835b82 req-1310bc42-48ba-4620-be34-95de222ed9c6 tempest-AttachVolumeNegativeTest-820855793 None] Deleting attachment 58f178a8-42fd-4180-b854-03e4287939e8. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:21:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-e8ad30e6-3922-44f9-9369-841b124e7e8c req-e4e69398-f123-4fe6-8144-e2c877865cce tempest-DeleteServersTestJSON-1990022567 None] Terminate volume connection completed successfully. Jun 23 04:21:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-e8ad30e6-3922-44f9-9369-841b124e7e8c req-e4e69398-f123-4fe6-8144-e2c877865cce tempest-DeleteServersTestJSON-1990022567 None] Deleting attachment 76018692-1ca3-40cf-a175-9e31597db78f. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:21:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Acquiring lock "cinder-2ef6ed54-942c-4a9c-9486-9c3d87d23683-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:21:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Lock "cinder-2ef6ed54-942c-4a9c-9486-9c3d87d23683-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:21:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Acquiring lock "cinder-quobyte-2ef6ed54-942c-4a9c-9486-9c3d87d23683" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:21:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Lock "cinder-quobyte-2ef6ed54-942c-4a9c-9486-9c3d87d23683" acquired by "delete_volume" :: waited 0.045s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:21:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[552d0a9a-d544-4145-aef6-30ffd8f5a201]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:21:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:51 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 Jun 23 04:21:51 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:52 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683" returned: 0 in 0.893s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:52 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683 Jun 23 04:21:52 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:53 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ef6ed54-942c-4a9c-9486-9c3d87d23683" returned: 0 in 0.867s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Lock "cinder-quobyte-2ef6ed54-942c-4a9c-9486-9c3d87d23683" released by "delete_volume" :: held 1.842s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Created reservations ['66c362ff-ccf0-4755-8d76-d094f0ef76d7', '905338db-3ff8-41a6-ba7b-94445f6ac26c', '0eb985ee-182b-4c6b-8b87-6f925ebc9a95', '7c0cc2b9-d6f0-45fa-a3fd-08f295603616'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:53 devstack sudo[96864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:21:53 devstack sudo[96864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:54 devstack sudo[96864]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.722s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:21:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Deleted volume successfully. Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3c9123b-4122-4fda-a86a-7805e71528af tempest-DeleteServersTestJSON-1990022567 None] Lock "cinder-2ef6ed54-942c-4a9c-9486-9c3d87d23683-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:21:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:21:54 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:21:54 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:21:55 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Jun 23 04:21:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.812s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:21:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:22:03 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=25,cinder:SELECT=37,cinder:INSERT=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:22:04 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=17,cinder:UPDATE=13,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:22:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-8284c863-a728-4aa0-a803-3006b2bd5a2b req-5774514e-bdaf-48f0-8687-bfa19c2fe9cf tempest-ServerActionsTestOtherA-1894687364 None] Terminate volume connection completed successfully. Jun 23 04:22:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-8284c863-a728-4aa0-a803-3006b2bd5a2b req-5774514e-bdaf-48f0-8687-bfa19c2fe9cf tempest-ServerActionsTestOtherA-1894687364 None] Deleting attachment 4b2ee230-21b6-4cd9-a01b-4faee891d7df. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:22:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "cinder-6187e379-6c58-4173-a4f8-d0fb45d8259f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Lock "cinder-6187e379-6c58-4173-a4f8-d0fb45d8259f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "cinder-quobyte-6187e379-6c58-4173-a4f8-d0fb45d8259f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Lock "cinder-quobyte-6187e379-6c58-4173-a4f8-d0fb45d8259f" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ad533-2f3c-4233-8e58-8c5b94421f1e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:22:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:19 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f Jun 23 04:22:19 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:21 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f" returned: 0 in 1.319s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:21 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f Jun 23 04:22:21 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:22 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6187e379-6c58-4173-a4f8-d0fb45d8259f" returned: 0 in 1.040s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Lock "cinder-quobyte-6187e379-6c58-4173-a4f8-d0fb45d8259f" released by "delete_volume" :: held 2.422s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Created reservations ['cf113152-7b58-427d-80d4-cd77afda5734', 'de1f3c3f-0c19-4153-83f6-6f15445194c3', '9ace766c-a75f-4920-a46d-31951b498063', '297eadbd-4fff-4128-b36a-0924dfeef1f0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:22 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:22:22 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:23 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.831s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:23 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:22:23 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Deleted volume successfully. Jun 23 04:22:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2cb4ae1c-8183-491a-810d-34536aebb375 tempest-ServerActionsTestOtherA-1894687364 None] Lock "cinder-6187e379-6c58-4173-a4f8-d0fb45d8259f-delete_volume" released by "delete_volume" :: held 3.708s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:22:32 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:22:33 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=5,cinder:UPDATE=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Flow 'volume_create_manager' (34cb779a-5577-40a1-8adb-b457b056248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516a0345-8114-4dfe-9bbd-93e1ff7a9b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (516a0345-8114-4dfe-9bbd-93e1ff7a9b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2089656936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9358d55-78a6-484f-a8a9-8e0edc896001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f16906caca9469c9bd6804e8eefc43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:36Z,use_quota=True,user_id='2d8d4bed81f041e79a82cbe0ea150b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c91b3c-db20-4ee4-9f58-9db3f0a24378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c91b3c-db20-4ee4-9f58-9db3f0a24378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d4c865-f461-449f-b25f-af0348ce0341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d4c865-f461-449f-b25f-af0348ce0341) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9358d55-78a6-484f-a8a9-8e0edc896001', 'volume_name': 'volume-b9358d55-78a6-484f-a8a9-8e0edc896001', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dedd35a-bf67-430b-862f-06543e08c15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dedd35a-bf67-430b-862f-06543e08c15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b85f287-9e29-4c0f-a793-2895d00c731d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:36 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Volume b9358d55-78a6-484f-a8a9-8e0edc896001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9358d55-78a6-484f-a8a9-8e0edc896001', 'volume_size': 1} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-2089656936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9358d55-78a6-484f-a8a9-8e0edc896001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f16906caca9469c9bd6804e8eefc43e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:36Z,use_quota=True,user_id='2d8d4bed81f041e79a82cbe0ea150b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Creating volume b9358d55-78a6-484f-a8a9-8e0edc896001 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:22:36 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:22:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:36 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 1073741824 Jun 23 04:22:36 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:37 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 1073741824" returned: 0 in 1.153s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:37 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 Jun 23 04:22:37 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:38 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001" returned: 0 in 0.801s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] <== create_volume: return (2010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b85f287-9e29-4c0f-a793-2895d00c731d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9358d55-78a6-484f-a8a9-8e0edc896001', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace02cb2-296d-4322-a1ec-e57444681da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:38 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Volume volume-b9358d55-78a6-484f-a8a9-8e0edc896001 (b9358d55-78a6-484f-a8a9-8e0edc896001): created successfully Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace02cb2-296d-4322-a1ec-e57444681da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Flow 'volume_create_manager' (34cb779a-5577-40a1-8adb-b457b056248c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2f9eefd0-6959-46e5-90c4-45526779f4df tempest-TaggedAttachmentsTest-1787004581 None] Created volume successfully. Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Flow 'volume_create_manager' (109a8395-b82f-430b-9d39-f7c784cbf209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bf9e86-a78c-40b6-b312-85586aa8c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0bf9e86-a78c-40b6-b312-85586aa8c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1654281754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb60d9a-5956-4bf5-a1a1-8a996b8daa05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b6e5bdca214593b83c9962c51bbac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:45Z,use_quota=True,user_id='b2b6b4608df64d1f876f41e8906c2faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6a1826-d98d-4a55-bc16-fa0abe156b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6a1826-d98d-4a55-bc16-fa0abe156b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5220aeab-7b0d-4085-812d-58a858c9ff17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5220aeab-7b0d-4085-812d-58a858c9ff17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb60d9a-5956-4bf5-a1a1-8a996b8daa05', 'volume_name': 'volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c999814-66ad-4dc9-938b-765ae43a3643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c999814-66ad-4dc9-938b-765ae43a3643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5917d550-65a5-406f-b4ee-61a46d264b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Volume bbb60d9a-5956-4bf5-a1a1-8a996b8daa05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05', 'volume_size': 1} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1654281754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb60d9a-5956-4bf5-a1a1-8a996b8daa05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56b6e5bdca214593b83c9962c51bbac7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:45Z,use_quota=True,user_id='b2b6b4608df64d1f876f41e8906c2faa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Creating volume bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:22:44 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:22:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:44 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 1073741824 Jun 23 04:22:44 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:45 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 1073741824" returned: 0 in 0.891s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:45 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 Jun 23 04:22:45 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:22:46 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Flow 'volume_create_manager' (9f869f75-fcb0-4bb2-9a3e-3305f39eb402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdde23d5-db4a-49db-bf21-5c717ff27620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" returned: 0 in 0.807s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.759s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdde23d5-db4a-49db-bf21-5c717ff27620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-836622038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca35e4a-394d-4248-8a14-aafd4ef1057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4adf625f6514704b53ac3eee3318ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:46Z,use_quota=True,user_id='b24b7a13b0f74b069944c04275649c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9045b0a7-f642-4440-9d4f-0066d41d5fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9045b0a7-f642-4440-9d4f-0066d41d5fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78a6185-9b0d-42c6-9baf-1418b9a729ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78a6185-9b0d-42c6-9baf-1418b9a729ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ca35e4a-394d-4248-8a14-aafd4ef1057a', 'volume_name': 'volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c236e1-a4e6-4488-9d27-e06efe356851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44c236e1-a4e6-4488-9d27-e06efe356851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00621c26-a949-4416-8fd9-3bbdf6f26e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Volume 8ca35e4a-394d-4248-8a14-aafd4ef1057a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a', 'volume_size': 1} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-836622038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ca35e4a-394d-4248-8a14-aafd4ef1057a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4adf625f6514704b53ac3eee3318ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:46Z,use_quota=True,user_id='b24b7a13b0f74b069944c04275649c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Creating volume 8ca35e4a-394d-4248-8a14-aafd4ef1057a {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:22:46 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:46 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a 1073741824 Jun 23 04:22:46 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5917d550-65a5-406f-b4ee-61a46d264b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec05d64-f63f-4377-a781-d81e438c0cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Volume volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 (bbb60d9a-5956-4bf5-a1a1-8a996b8daa05): created successfully Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ec05d64-f63f-4377-a781-d81e438c0cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Flow 'volume_create_manager' (109a8395-b82f-430b-9d39-f7c784cbf209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-513ada37-9adc-4776-9051-3882e2fddc1d req-4a2215c7-352d-4518-a0aa-4ab68d220762 tempest-VolumesSnapshotsTestJSON-391519510 None] Created volume successfully. Jun 23 04:22:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:47 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a 1073741824" returned: 0 in 0.902s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:47 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a Jun 23 04:22:47 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:48 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a" returned: 0 in 0.644s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.084s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Creating offline snapshot b34a79ac-aac4-4238-89c4-90604949af11 of volume bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00621c26-a949-4416-8fd9-3bbdf6f26e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0310fc6-a05c-41e6-98c3-5f359de424ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ddbf04-68fa-490e-94d5-76d5ea4fcac8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Volume volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a (8ca35e4a-394d-4248-8a14-aafd4ef1057a): created successfully Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0310fc6-a05c-41e6-98c3-5f359de424ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Flow 'volume_create_manager' (9f869f75-fcb0-4bb2-9a3e-3305f39eb402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:48 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b3e0bb7a-a53c-4586-b956-97184c7d5afe tempest-AttachVolumeNegativeTest-820855793 None] Created volume successfully. Jun 23 04:22:48 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 Jun 23 04:22:48 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:48 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" returned: 0 in 0.834s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:49 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 1G Jun 23 04:22:49 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:49 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 1G" returned: 0 in 0.979s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:49 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 Jun 23 04:22:49 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:50 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11" returned: 0 in 0.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:50 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 is being set with open permissions: ugo+rw Jun 23 04:22:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:50 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 Jun 23 04:22:50 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:51 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11" returned: 0 in 0.782s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:51 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info Jun 23 04:22:51 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:52 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info" returned: 0 in 0.694s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:52 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info is being set with open permissions: ugo+rw Jun 23 04:22:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:52 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info Jun 23 04:22:52 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:52 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.info" returned: 0 in 0.710s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.873s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.410s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dced381-6a8c-4a4a-b06d-49402ca26012]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:53 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-85a9b230-109a-43c5-8564-99f458d58d0e req-0a00e47d-8db4-4892-9e88-ee3fdbff18a6 tempest-VolumesSnapshotsTestJSON-391519510 None] Create snapshot completed successfully Jun 23 04:22:53 devstack sudo[97479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a Jun 23 04:22:53 devstack sudo[97479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "cinder-b34a79ac-aac4-4238-89c4-90604949af11-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-b34a79ac-aac4-4238-89c4-90604949af11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "cinder-quobyte-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-quobyte-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "cinder-quobyte-b34a79ac-aac4-4238-89c4-90604949af11" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-quobyte-b34a79ac-aac4-4238-89c4-90604949af11" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Deleting offline snapshot b34a79ac-aac4-4238-89c4-90604949af11 of volume bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] snapshot_file for this snap is: volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda4eea1-0bd9-46c8-81c4-0d1c2c6d76a6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:53 devstack sudo[97479]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a" returned: 0 in 0.972s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.992s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b571766e-2121-4562-b07e-b36b73d8db3f', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:22:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-53ea0a8a-6035-4f94-994a-8dfffc2914c9 req-9c003aff-fbd5-4c7e-a7ab-cb4701d80c0f tempest-AttachVolumeNegativeTest-820855793 None] attachment_update completed successfully. Jun 23 04:22:54 devstack sudo[97489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 Jun 23 04:22:54 devstack sudo[97489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:54 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:22:54 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:54 devstack sudo[97489]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11" returned: 0 in 0.999s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[466ffd71-0f4a-47f9-a4a0-72eff6a4c182]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:22:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:55 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 Jun 23 04:22:55 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:55 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.739s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 8 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:22:55 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" returned: 0 in 0.811s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:55 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 Jun 23 04:22:55 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:56 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11" returned: 0 in 0.829s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:56 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11 Jun 23 04:22:56 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Flow 'volume_create_manager' (0eddec7e-ecfa-4a36-9885-abdd0df5fa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda10712-3e20-4f82-82bc-83e654acfa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:57 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cda10712-3e20-4f82-82bc-83e654acfa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1239316926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3e69a7-20b1-4865-aed6-b6a4d401f255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd99e4b97546c1818e441b3258f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:58Z,use_quota=True,user_id='aecb1feb542b4a5cb2543e027326a3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c74def6-26f4-413a-92bb-ee7b613da522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c74def6-26f4-413a-92bb-ee7b613da522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61031020-44da-44cd-bff2-730eea899dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61031020-44da-44cd-bff2-730eea899dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3e69a7-20b1-4865-aed6-b6a4d401f255', 'volume_name': 'volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e8036f-e2b5-4c82-8f4b-17211efe0c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49e8036f-e2b5-4c82-8f4b-17211efe0c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e98a20-427c-45ef-a5dc-2b553e46df4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:22:57 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Volume 9a3e69a7-20b1-4865-aed6-b6a4d401f255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255', 'volume_size': 1} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1239316926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3e69a7-20b1-4865-aed6-b6a4d401f255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd99e4b97546c1818e441b3258f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:22:58Z,use_quota=True,user_id='aecb1feb542b4a5cb2543e027326a3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Creating volume 9a3e69a7-20b1-4865-aed6-b6a4d401f255 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:22:57 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05.b34a79ac-aac4-4238-89c4-90604949af11" returned: 0 in 1.358s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:58 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 1073741824 Jun 23 04:22:58 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-quobyte-b34a79ac-aac4-4238-89c4-90604949af11" released by "_delete_snapshot" :: held 4.136s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-quobyte-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" released by "delete_snapshot" :: held 4.171s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:22:58 devstack cinder-volume[93326]: WARNING cinder.quota [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.quota [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Created reservations ['f6f1edb7-f1cc-4e48-a12e-1849747daf03', '2fc3ef1f-c201-47ca-98ff-679c8c4398bd', '26d8e80e-c380-41c3-ad4b-599f0be314be', '5abb027b-a02f-4970-9b1f-74384eb3df52'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:22:58 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Delete snapshot completed successfully. Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-4e7bf0ca-2d4d-4470-ae48-22762cbe4eb2 req-8a9715f7-e1ea-4d31-bd11-4e16ed1a3f61 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-b34a79ac-aac4-4238-89c4-90604949af11-delete_snapshot" released by "delete_snapshot" :: held 4.360s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "cinder-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "cinder-quobyte-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-quobyte-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89e2c25-1802-4862-8929-5cddd4ca0cff]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:22:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:58 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 Jun 23 04:22:58 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:59 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 1073741824" returned: 0 in 1.356s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:59 devstack sudo[97997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 Jun 23 04:22:59 devstack sudo[97997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:22:59 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Jun 23 04:22:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" returned: 0 in 1.200s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:22:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:22:59 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05 Jun 23 04:22:59 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:00 devstack sudo[97997]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255" returned: 0 in 0.871s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] <== create_volume: return (2321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.325s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e98a20-427c-45ef-a5dc-2b553e46df4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598bc62a-e20a-41f8-9f19-9b8b7040497f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Volume volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 (9a3e69a7-20b1-4865-aed6-b6a4d401f255): created successfully Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598bc62a-e20a-41f8-9f19-9b8b7040497f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Flow 'volume_create_manager' (0eddec7e-ecfa-4a36-9885-abdd0df5fa88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4ada47e6-4fca-4bb9-b993-cfaa24012f46 tempest-AttachVolumeTestJSON-656889715 None] Created volume successfully. Jun 23 04:23:00 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" returned: 0 in 0.709s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-quobyte-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05" released by "delete_volume" :: held 2.026s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.quota [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Created reservations ['bf0dd4fb-aeb7-4d23-84f8-41729294e213', 'a19f0cf3-1595-45c0-a0e2-5098497e640b', '45a9837f-bec9-430e-b17a-8aea932b3316', 'c59703e5-3386-4cb5-af25-0bde5422777a'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:00 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:23:00 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-db5a7225-5d06-4fa1-8a67-3be75a31a426 req-ac56b2d9-deb0-46f6-8a70-d4264c341636 tempest-AttachVolumeNegativeTest-820855793 None] Terminate volume connection completed successfully. Jun 23 04:23:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-db5a7225-5d06-4fa1-8a67-3be75a31a426 req-ac56b2d9-deb0-46f6-8a70-d4264c341636 tempest-AttachVolumeNegativeTest-820855793 None] Deleting attachment b571766e-2121-4562-b07e-b36b73d8db3f. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:23:01 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.024s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:01 devstack cinder-volume[93326]: DEBUG cinder.manager [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:23:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Deleted volume successfully. Jun 23 04:23:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-d516731f-1810-42f6-adf8-622e2960bace req-ff0a6664-2063-4826-8767-981cd831e002 tempest-VolumesSnapshotsTestJSON-391519510 None] Lock "cinder-bbb60d9a-5956-4bf5-a1a1-8a996b8daa05-delete_volume" released by "delete_volume" :: held 3.364s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbdf8f1-a59d-4962-bf53-8df9b79cf70f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:05 devstack sudo[98095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 Jun 23 04:23:05 devstack sudo[98095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:06 devstack sudo[98095]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255" returned: 0 in 1.053s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.072s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a82600b-6358-4eb8-89d1-852d799b42cd', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:23:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-29bccba2-e1a2-4a7d-9ba4-d7f71ff39150 req-020a4d89-13a7-44df-b9c2-3094afbfda63 tempest-AttachVolumeTestJSON-656889715 None] attachment_update completed successfully. Jun 23 04:23:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-bf851636-93b5-4e2e-be25-5590d0497354 tempest-GroupSnapshotsTest-1192531673 None] Group tempest-GroupSnapshotsTest-Group-1475079494: creating Jun 23 04:23:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-bf851636-93b5-4e2e-be25-5590d0497354 tempest-GroupSnapshotsTest-1192531673 None] Group tempest-GroupSnapshotsTest-Group-1475079494: created successfully Jun 23 04:23:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-bf851636-93b5-4e2e-be25-5590d0497354 tempest-GroupSnapshotsTest-1192531673 None] Create group completed successfully. Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (d3b8adfe-d57f-4e7e-a43f-e7e80623cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a310339-b9f0-4b3d-9dd5-43461c100f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a310339-b9f0-4b3d-9dd5-43461c100f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-857837384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2317842-52a2-4649-9d7c-1674f71c4a63,host='devstack@QuobyteHD#QuobyteHD',id=faed8a8b-1df2-4c8a-80ce-a10368277a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:23:09Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(541f369a-4f54-47f6-869b-646c1bf04c0d),volume_type_id=541f369a-4f54-47f6-869b-646c1bf04c0d)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986d5a59-67e3-4793-950c-f6e7282824d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986d5a59-67e3-4793-950c-f6e7282824d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d157d3-5b42-4887-8942-d1e23f97cc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d157d3-5b42-4887-8942-d1e23f97cc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faed8a8b-1df2-4c8a-80ce-a10368277a27', 'volume_name': 'volume-faed8a8b-1df2-4c8a-80ce-a10368277a27', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db59795-1189-40e2-9530-8f4fe6446904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db59795-1189-40e2-9530-8f4fe6446904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f646f1d-1a82-4b61-89a6-39dd8ac8cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:09 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Volume faed8a8b-1df2-4c8a-80ce-a10368277a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faed8a8b-1df2-4c8a-80ce-a10368277a27', 'volume_size': 1} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a2317842-52a2-4649-9d7c-1674f71c4a63,created_at=2026-06-23T02:23:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-857837384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a2317842-52a2-4649-9d7c-1674f71c4a63,host='devstack@QuobyteHD#QuobyteHD',id=faed8a8b-1df2-4c8a-80ce-a10368277a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:23:09Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(541f369a-4f54-47f6-869b-646c1bf04c0d),volume_type_id=541f369a-4f54-47f6-869b-646c1bf04c0d)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Creating volume faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:23:09 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:23:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:09 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 1073741824 Jun 23 04:23:09 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:10 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 1073741824" returned: 0 in 0.878s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:10 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:10 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:10 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f646f1d-1a82-4b61-89a6-39dd8ac8cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faed8a8b-1df2-4c8a-80ce-a10368277a27', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9727fa-b737-493c-89d6-601ece5b0b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:10 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Volume volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 (faed8a8b-1df2-4c8a-80ce-a10368277a27): created successfully Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9727fa-b737-493c-89d6-601ece5b0b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (d3b8adfe-d57f-4e7e-a43f-e7e80623cece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:10 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-20f9b017-b673-4203-a64f-c221b12e9c37 tempest-GroupSnapshotsTest-1192531673 None] Created volume successfully. Jun 23 04:23:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] GroupSnapshot bdb7692a-fc41-4574-a664-b25b3ada1416: creating. Jun 23 04:23:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Group snapshot bdb7692a-fc41-4574-a664-b25b3ada1416: creating. {{(pid=93326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 04:23:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Creating offline snapshot a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 of volume faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:23:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f118e74-241c-410c-8d76-ea736119b5d5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:12 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:12 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:12 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 0.852s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:12 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 1G Jun 23 04:23:12 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:14 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 1G" returned: 0 in 1.207s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:14 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 Jun 23 04:23:14 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:14 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" returned: 0 in 0.743s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:14 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:23:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:14 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 Jun 23 04:23:14 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:15 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" returned: 0 in 0.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:15 devstack sudo[98589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info Jun 23 04:23:15 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:16 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info" returned: 0 in 0.732s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:16 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:23:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:16 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info Jun 23 04:23:16 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:17 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.info" returned: 0 in 0.710s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.058s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cc389c1d-431a-444c-abf3-ab1dee749436 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bdb7692a-fc41-4574-a664-b25b3ada1416: created successfully Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-a7c60f72-028c-4ebc-9d0d-f91e1c97beb4-0f920368-62f0-4bd3-9cd0-82e17c91bffd" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a7c60f72-028c-4ebc-9d0d-f91e1c97beb4-0f920368-62f0-4bd3-9cd0-82e17c91bffd" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Creating volume 0f920368-62f0-4bd3-9cd0-82e17c91bffd from snapshot a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-0f920368-62f0-4bd3-9cd0-82e17c91bffd" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-0f920368-62f0-4bd3-9cd0-82e17c91bffd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] snapshot: a7c60f72-028c-4ebc-9d0d-f91e1c97beb4, volume: 0f920368-62f0-4bd3-9cd0-82e17c91bffd, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[548002dc-10b6-48ba-af8a-22aa453eedad]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:18 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 Jun 23 04:23:18 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:19 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" returned: 0 in 0.864s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faed8a8b-1df2-4c8a-80ce-a10368277a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:23:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:23:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:23:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4bbd7f-615a-48a1-8d7d-ebe56774ecd2]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:19 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:19 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:20 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:20 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:23:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:20 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd Jun 23 04:23:20 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:26 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd" returned: 0 in 6.601s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92cbcd83-bd40-4ca9-bab2-57fa5073a63e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:27 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:27 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:28 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 1.523s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:28 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:23:28 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Converted 1024.00 MB image at 155.10 MB/s Jun 23 04:23:28 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:23:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:28 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd Jun 23 04:23:28 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:28 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=45,cinder:INSERT=4,cinder:UPDATE=27,cinder:DELETE=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:23:28 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=45,cinder:DELETE=5,cinder:SELECT=47,cinder:INSERT=11 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:23:29 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd" returned: 0 in 1.043s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-0f920368-62f0-4bd3-9cd0-82e17c91bffd" released by "_copy_volume_from_snapshot" :: held 10.934s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a7c60f72-028c-4ebc-9d0d-f91e1c97beb4-0f920368-62f0-4bd3-9cd0-82e17c91bffd" released by "_create_volume_from_snapshot" :: held 10.968s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.988s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:29 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-36c205cd-d1f5-404b-b23a-65f69b2d03d5 tempest-GroupSnapshotsTest-1192531673 None] Create group from source-snapshot-bdb7692a-fc41-4574-a664-b25b3ada1416 completed successfully. Jun 23 04:23:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-0f920368-62f0-4bd3-9cd0-82e17c91bffd" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:23:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-0f920368-62f0-4bd3-9cd0-82e17c91bffd" acquired by "delete_volume" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:23:30 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd9b688-76cd-4ff2-be60-5675b4174c96]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:30 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd Jun 23 04:23:30 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:31 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd" returned: 0 in 1.055s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:31 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd Jun 23 04:23:31 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:32 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0f920368-62f0-4bd3-9cd0-82e17c91bffd" returned: 0 in 0.655s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-0f920368-62f0-4bd3-9cd0-82e17c91bffd" released by "delete_volume" :: held 1.759s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['042a7279-d6f9-4319-a09b-4078a037128a'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:23:32 devstack cinder-volume[93326]: WARNING cinder.quota [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-923475928 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-923475928, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:23:32 devstack cinder-volume[93326]: WARNING cinder.quota [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-923475928 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-923475928, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['45946db7-9129-4e0d-8232-e007d0122ef1', 'd6345b50-06e6-4992-8ce2-1aac19582ab5', 'e94d9079-da7c-43bf-9281-8e5f64d9100e', '25c4f8f7-9d35-4d56-83c8-4b1bb87a74b2'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:32 devstack sudo[99201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:23:32 devstack sudo[99201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bdb7692a-fc41-4574-a664-b25b3ada1416: deleting Jun 23 04:23:33 devstack sudo[99201]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.969s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:23:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c769c216-5867-4e6d-9615-039b50369c61 tempest-GroupSnapshotsTest-1192531673 None] Delete group completed successfully. Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bdb7692a-fc41-4574-a664-b25b3ada1416: deleting {{(pid=93326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-faed8a8b-1df2-4c8a-80ce-a10368277a27" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-faed8a8b-1df2-4c8a-80ce-a10368277a27" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Deleting offline snapshot a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 of volume faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] snapshot_file for this snap is: volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ba8983-e02f-4155-acda-5988ac89a9f5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:34 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 Jun 23 04:23:34 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:35 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" returned: 0 in 1.659s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-faed8a8b-1df2-4c8a-80ce-a10368277a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:23:35 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d193fa0-389a-4ca7-b041-38bbacf1f5ec]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:36 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:36 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:37 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 1.606s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:37 devstack sudo[99336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 Jun 23 04:23:37 devstack sudo[99336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:38 devstack sudo[99336]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" returned: 0 in 1.049s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:38 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4 Jun 23 04:23:38 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:39 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27.a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" returned: 0 in 1.024s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a7c60f72-028c-4ebc-9d0d-f91e1c97beb4" released by "_delete_snapshot" :: held 5.613s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-faed8a8b-1df2-4c8a-80ce-a10368277a27" released by "delete_snapshot" :: held 5.677s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:39 devstack cinder-volume[93326]: WARNING cinder.quota [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-923475928 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-923475928, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:23:39 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['00ec0a75-18cb-46d0-b37c-b2b0b4753596', 'cb4e3c6f-0a64-4008-a0d0-dbe764b5df0f', '83517b39-036f-4016-8726-e8b936576c25', '737eeb74-bf14-4459-8072-05ac7b4f4122'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:23:39 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a66da302-edb7-4abb-a9bc-6d4d779ef2ca tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bdb7692a-fc41-4574-a664-b25b3ada1416: deleted successfully Jun 23 04:23:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-faed8a8b-1df2-4c8a-80ce-a10368277a27" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:23:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-faed8a8b-1df2-4c8a-80ce-a10368277a27" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:23:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebf9cff-58f3-468a-9563-bd69866ad13a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:40 devstack sudo[99351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:40 devstack sudo[99351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:41 devstack sudo[99351]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 1.075s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:41 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27 Jun 23 04:23:41 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:42 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-faed8a8b-1df2-4c8a-80ce-a10368277a27" returned: 0 in 0.813s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-faed8a8b-1df2-4c8a-80ce-a10368277a27" released by "delete_volume" :: held 1.983s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['40ba5de3-db47-43ae-b600-a4cbf54201ce'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:23:42 devstack cinder-volume[93326]: WARNING cinder.db.api [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-923475928'] Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['f148628e-b26a-495a-8926-8b2b024940aa', 'd7e8ee79-8b34-4488-b53f-a2017ac648c0', '98e4d912-84f5-4c7e-a0c1-438d2cddbebd', 'beeab0bd-24ff-4bb5-adc3-a5cc7f779bfd'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:42 devstack sudo[99400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:23:42 devstack sudo[99400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb9be7-724b-4973-8575-01f5925da679]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be2de1cf-d373-48a1-a9a4-34a14eaa77bd tempest-GroupSnapshotsTest-1192531673 None] Group tempest-GroupSnapshotsTest-Group-857923427: creating Jun 23 04:23:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be2de1cf-d373-48a1-a9a4-34a14eaa77bd tempest-GroupSnapshotsTest-1192531673 None] Group tempest-GroupSnapshotsTest-Group-857923427: created successfully Jun 23 04:23:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be2de1cf-d373-48a1-a9a4-34a14eaa77bd tempest-GroupSnapshotsTest-1192531673 None] Create group completed successfully. Jun 23 04:23:43 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 Jun 23 04:23:43 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:43 devstack sudo[99400]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.851s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:23:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b4fe2512-fe6f-4085-8c93-cedefa3c4318 tempest-GroupSnapshotsTest-1192531673 None] Delete group completed successfully. Jun 23 04:23:43 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001" returned: 0 in 0.880s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.903s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-b9358d55-78a6-484f-a8a9-8e0edc896001', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81291620-6eb4-4e10-9123-58d2371a7203', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:23:44 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-ac012228-46f2-4463-8431-947ba56f51ff req-2cef90ef-cf10-4e7b-8814-588c2338f981 tempest-TaggedAttachmentsTest-1787004581 None] attachment_update completed successfully. Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (65271364-953e-4139-bbc7-051b572f304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdb092f-94d1-495b-b494-a47635fb8d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bdb092f-94d1-495b-b494-a47635fb8d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318682710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95450781-c1da-4f7b-bb03-7dd1ca95d088,host='devstack@QuobyteHD#QuobyteHD',id=ce585222-67ae-46ed-a198-c0492e142544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:23:45Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(877c0a4f-217f-4a6c-9be5-7caa3048204c),volume_type_id=877c0a4f-217f-4a6c-9be5-7caa3048204c)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d25131-4123-48c0-98a3-97b02edc4355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10d25131-4123-48c0-98a3-97b02edc4355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808778df-d142-464f-abb3-60cf8f38a726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808778df-d142-464f-abb3-60cf8f38a726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce585222-67ae-46ed-a198-c0492e142544', 'volume_name': 'volume-ce585222-67ae-46ed-a198-c0492e142544', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99931f1-19d8-4484-a9d2-c8a420c74f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d99931f1-19d8-4484-a9d2-c8a420c74f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734ab363-2f9e-4d3f-9019-f6bd8f63c27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Volume ce585222-67ae-46ed-a198-c0492e142544: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce585222-67ae-46ed-a198-c0492e142544', 'volume_size': 1} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95450781-c1da-4f7b-bb03-7dd1ca95d088,created_at=2026-06-23T02:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1318682710',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95450781-c1da-4f7b-bb03-7dd1ca95d088,host='devstack@QuobyteHD#QuobyteHD',id=ce585222-67ae-46ed-a198-c0492e142544,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:23:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:23:45Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(877c0a4f-217f-4a6c-9be5-7caa3048204c),volume_type_id=877c0a4f-217f-4a6c-9be5-7caa3048204c)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Creating volume ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:23:44 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:23:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:44 devstack sudo[99417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 1073741824 Jun 23 04:23:44 devstack sudo[99417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:45 devstack sudo[99417]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 1073741824" returned: 0 in 0.879s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:45 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 Jun 23 04:23:45 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:46 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544" returned: 0 in 0.647s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] <== create_volume: return (1567ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (734ab363-2f9e-4d3f-9019-f6bd8f63c27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce585222-67ae-46ed-a198-c0492e142544', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f96bebe-e68f-4eb0-a069-b978018bef0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Volume volume-ce585222-67ae-46ed-a198-c0492e142544 (ce585222-67ae-46ed-a198-c0492e142544): created successfully Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f96bebe-e68f-4eb0-a069-b978018bef0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (65271364-953e-4139-bbc7-051b572f304e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1d027f44-1cf4-485f-afbd-01654be9801f tempest-GroupSnapshotsTest-1192531673 None] Created volume successfully. Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (c70d284e-8d9d-48d3-9252-fa0ba925fbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324c501-59e6-44af-9d92-5110b27520de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a324c501-59e6-44af-9d92-5110b27520de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1411794059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95450781-c1da-4f7b-bb03-7dd1ca95d088,host='devstack@QuobyteHD#QuobyteHD',id=8e6c4855-e869-494f-8227-61cd285b47c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:23:48Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(877c0a4f-217f-4a6c-9be5-7caa3048204c),volume_type_id=877c0a4f-217f-4a6c-9be5-7caa3048204c)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e1c511-a9f8-4c8d-bcc1-85a37cebd044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e1c511-a9f8-4c8d-bcc1-85a37cebd044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683d904c-fd19-4f17-a983-c188f4a2916b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (683d904c-fd19-4f17-a983-c188f4a2916b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e6c4855-e869-494f-8227-61cd285b47c2', 'volume_name': 'volume-8e6c4855-e869-494f-8227-61cd285b47c2', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2734a78e-a5c3-46a6-b900-544e2b37ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2734a78e-a5c3-46a6-b900-544e2b37ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dace69-099a-4e48-8f56-7d8959db6944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:47 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Volume 8e6c4855-e869-494f-8227-61cd285b47c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e6c4855-e869-494f-8227-61cd285b47c2', 'volume_size': 1} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=95450781-c1da-4f7b-bb03-7dd1ca95d088,created_at=2026-06-23T02:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1411794059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=95450781-c1da-4f7b-bb03-7dd1ca95d088,host='devstack@QuobyteHD#QuobyteHD',id=8e6c4855-e869-494f-8227-61cd285b47c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:23:48Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(877c0a4f-217f-4a6c-9be5-7caa3048204c),volume_type_id=877c0a4f-217f-4a6c-9be5-7caa3048204c)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Creating volume 8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:23:47 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:23:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:47 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 1073741824 Jun 23 04:23:47 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:48 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 1073741824" returned: 0 in 0.838s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:48 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 Jun 23 04:23:48 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:49 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2" returned: 0 in 0.814s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69dace69-099a-4e48-8f56-7d8959db6944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e6c4855-e869-494f-8227-61cd285b47c2', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d0edda-1104-4935-9460-673ed77576ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Volume volume-8e6c4855-e869-494f-8227-61cd285b47c2 (8e6c4855-e869-494f-8227-61cd285b47c2): created successfully Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09d0edda-1104-4935-9460-673ed77576ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (c70d284e-8d9d-48d3-9252-fa0ba925fbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:49 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-63b88233-5afb-4bda-b583-7afc7ac670af tempest-GroupSnapshotsTest-1192531673 None] Created volume successfully. Jun 23 04:23:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c718a73a-7aa8-4f53-a18f-b59082e5df03 tempest-GroupSnapshotsTest-1192531673 None] Update group completed successfully. Jun 23 04:23:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-bd55b40b-b063-4f68-b916-c9aad322d8c3 req-6798b89a-feef-4121-9fa9-843d485e0145 tempest-TaggedAttachmentsTest-1787004581 None] Terminate volume connection completed successfully. Jun 23 04:23:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-bd55b40b-b063-4f68-b916-c9aad322d8c3 req-6798b89a-feef-4121-9fa9-843d485e0145 tempest-TaggedAttachmentsTest-1787004581 None] Deleting attachment 81291620-6eb4-4e10-9123-58d2371a7203. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:23:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d0a9d552-1bf0-499e-a09c-cdc51af095d4 tempest-GroupSnapshotsTest-1192531673 None] Update group completed successfully. Jun 23 04:23:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b825aa93-86dd-49f0-98d7-e93a392777f2 tempest-GroupSnapshotsTest-1192531673 None] Update group completed successfully. Jun 23 04:23:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f285e508-cdd6-4797-8751-acadc1d89741 tempest-GroupSnapshotsTest-1192531673 None] Update group completed successfully. Jun 23 04:23:53 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-57f7f617-782c-4910-b967-b7e7a1db3804 req-b94fc09c-d8cd-4866-9c06-2d3ed35d90da tempest-AttachVolumeTestJSON-656889715 None] Terminate volume connection completed successfully. Jun 23 04:23:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-57f7f617-782c-4910-b967-b7e7a1db3804 req-b94fc09c-d8cd-4866-9c06-2d3ed35d90da tempest-AttachVolumeTestJSON-656889715 None] Deleting attachment 9a82600b-6358-4eb8-89d1-852d799b42cd. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:54 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:23:54 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] GroupSnapshot bb3db0a2-fccd-441c-b0f7-83cb6a4360fa: creating. Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Group snapshot bb3db0a2-fccd-441c-b0f7-83cb6a4360fa: creating. {{(pid=93326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Creating offline snapshot 50e94159-b091-459d-b872-76559bfc7cae of volume ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b58498b-bff5-43d5-8d8a-e6600f109a3c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:23:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:54 devstack sudo[99532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 Jun 23 04:23:54 devstack sudo[99532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:55 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.900s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 8 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:23:55 devstack sudo[99532]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544" returned: 0 in 1.042s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:55 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae 1G Jun 23 04:23:55 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:56 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae 1G" returned: 0 in 0.947s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce585222-67ae-46ed-a198-c0492e142544 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:56 devstack sudo[99587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce585222-67ae-46ed-a198-c0492e142544 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae Jun 23 04:23:56 devstack sudo[99587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:57 devstack sudo[99587]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ce585222-67ae-46ed-a198-c0492e142544 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae" returned: 0 in 0.865s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:57 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:23:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:57 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae Jun 23 04:23:57 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:58 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae" returned: 0 in 0.756s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:58 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info Jun 23 04:23:58 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:59 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info" returned: 0 in 0.745s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:23:59 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:23:59 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info Jun 23 04:23:59 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Flow 'volume_create_manager' (dd3c686b-4e13-41d1-8db9-0894077958cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f060e7d-f7e8-420b-adfc-0afb6e023d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f060e7d-f7e8-420b-adfc-0afb6e023d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-89651327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87c61d2-2daf-4bf7-8a45-09848736e88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4adf625f6514704b53ac3eee3318ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:24:00Z,use_quota=True,user_id='b24b7a13b0f74b069944c04275649c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0bb308-8c71-41a3-9ff2-d1be2c2cae24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca0bb308-8c71-41a3-9ff2-d1be2c2cae24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f72677-f2e0-43b3-b53e-1d41624bbf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f72677-f2e0-43b3-b53e-1d41624bbf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87c61d2-2daf-4bf7-8a45-09848736e88e', 'volume_name': 'volume-d87c61d2-2daf-4bf7-8a45-09848736e88e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae160b4-8a40-4cf5-a24e-1861871d917b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae160b4-8a40-4cf5-a24e-1861871d917b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f68ae7-e27d-499b-a2d0-ab7e163b7c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:23:59 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Volume d87c61d2-2daf-4bf7-8a45-09848736e88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87c61d2-2daf-4bf7-8a45-09848736e88e', 'volume_size': 1} Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:23:59 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jun 23 04:23:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.info" returned: 0 in 0.800s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.300s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Creating offline snapshot a55fbbb6-da25-4727-bc07-5d61220c1a2d of volume 8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c68418-e10d-4704-8058-2f33f193872c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:00 devstack sudo[99606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 Jun 23 04:24:00 devstack sudo[99606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:00 devstack sudo[99606]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2" returned: 0 in 0.868s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:00 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d 1G Jun 23 04:24:00 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:01 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d 1G" returned: 0 in 0.980s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6c4855-e869-494f-8227-61cd285b47c2 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:01 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6c4855-e869-494f-8227-61cd285b47c2 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d Jun 23 04:24:01 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:02 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e6c4855-e869-494f-8227-61cd285b47c2 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d" returned: 0 in 0.707s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:02 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:24:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:02 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d Jun 23 04:24:02 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:03 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d" returned: 0 in 0.844s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:03 devstack sudo[99693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info Jun 23 04:24:03 devstack sudo[99693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:04 devstack sudo[99693]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info" returned: 0 in 0.706s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:04 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:04 devstack sudo[99703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info Jun 23 04:24:04 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:04 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.info" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.071s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-89651327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87c61d2-2daf-4bf7-8a45-09848736e88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4adf625f6514704b53ac3eee3318ad4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:24:00Z,use_quota=True,user_id='b24b7a13b0f74b069944c04275649c34',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Creating volume d87c61d2-2daf-4bf7-8a45-09848736e88e {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:24:04 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:24:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:04 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e 1073741824 Jun 23 04:24:04 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-facd9c89-dfb5-4b27-9b46-b383e5788844 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bb3db0a2-fccd-441c-b0f7-83cb6a4360fa: created successfully Jun 23 04:24:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bb3db0a2-fccd-441c-b0f7-83cb6a4360fa: deleting Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bb3db0a2-fccd-441c-b0f7-83cb6a4360fa: deleting {{(pid=93326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-ce585222-67ae-46ed-a198-c0492e142544" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-ce585222-67ae-46ed-a198-c0492e142544" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-50e94159-b091-459d-b872-76559bfc7cae" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-50e94159-b091-459d-b872-76559bfc7cae" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Deleting offline snapshot 50e94159-b091-459d-b872-76559bfc7cae of volume ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] snapshot_file for this snap is: volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b95cd2a-33f8-475d-8677-27738adef473]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:05 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae Jun 23 04:24:05 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:05 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e 1073741824" returned: 0 in 1.058s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:06 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e Jun 23 04:24:06 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:06 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae" returned: 0 in 1.192s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ce585222-67ae-46ed-a198-c0492e142544(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:24:06 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[199047ac-b06b-4cf6-90a0-0f71740c96fe]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:07 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 Jun 23 04:24:07 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:07 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e" returned: 0 in 1.242s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] <== create_volume: return (2357ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.361s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f68ae7-e27d-499b-a2d0-ab7e163b7c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87c61d2-2daf-4bf7-8a45-09848736e88e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25afa35c-495f-4eb2-9191-4c79dab8d1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:07 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Volume volume-d87c61d2-2daf-4bf7-8a45-09848736e88e (d87c61d2-2daf-4bf7-8a45-09848736e88e): created successfully Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25afa35c-495f-4eb2-9191-4c79dab8d1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Flow 'volume_create_manager' (dd3c686b-4e13-41d1-8db9-0894077958cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:24:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a4a2d550-f76a-4335-9a8b-8bf7387aa6d5 tempest-AttachVolumeNegativeTest-820855793 None] Created volume successfully. Jun 23 04:24:07 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544" returned: 0 in 0.997s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:07 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae Jun 23 04:24:07 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:08 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae" returned: 0 in 0.937s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:08 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae Jun 23 04:24:08 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:09 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544.50e94159-b091-459d-b872-76559bfc7cae" returned: 0 in 0.840s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-50e94159-b091-459d-b872-76559bfc7cae" released by "_delete_snapshot" :: held 4.118s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-ce585222-67ae-46ed-a198-c0492e142544" released by "delete_snapshot" :: held 4.148s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-8e6c4855-e869-494f-8227-61cd285b47c2" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-8e6c4855-e869-494f-8227-61cd285b47c2" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-a55fbbb6-da25-4727-bc07-5d61220c1a2d" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a55fbbb6-da25-4727-bc07-5d61220c1a2d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Deleting offline snapshot a55fbbb6-da25-4727-bc07-5d61220c1a2d of volume 8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] snapshot_file for this snap is: volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d726a-5d1c-4d25-9cd8-1e8ff24461ea]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:10 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d Jun 23 04:24:10 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Acquiring lock "cinder-b9358d55-78a6-484f-a8a9-8e0edc896001-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Lock "cinder-b9358d55-78a6-484f-a8a9-8e0edc896001-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Acquiring lock "cinder-quobyte-b9358d55-78a6-484f-a8a9-8e0edc896001" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Lock "cinder-quobyte-b9358d55-78a6-484f-a8a9-8e0edc896001" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7954d4af-9c19-4ec6-8b0a-47dbcce3b6a9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:10 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 Jun 23 04:24:10 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:10 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d" returned: 0 in 1.030s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e6c4855-e869-494f-8227-61cd285b47c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[377fafd9-6b2e-4539-9da1-816ec8d3ffe0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:11 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 Jun 23 04:24:11 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:11 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001" returned: 0 in 0.876s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:11 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001 Jun 23 04:24:11 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea882ef-ae73-4d37-a2d8-9d1b59843c06]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:11 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e Jun 23 04:24:11 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:11 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2" returned: 0 in 0.858s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:11 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d Jun 23 04:24:11 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:12 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b9358d55-78a6-484f-a8a9-8e0edc896001" returned: 0 in 0.784s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Lock "cinder-quobyte-b9358d55-78a6-484f-a8a9-8e0edc896001" released by "delete_volume" :: held 1.732s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Created reservations ['f670ac5d-e598-4a5a-bcf7-5e1c20d91a0e', '76410415-28f8-4c4b-b72e-893d7a323856', '28a25940-a837-4e42-809b-488571b643e9', 'ff7d4fa7-4ad1-4b27-86ef-4cfb96db7cb6'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:12 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e" returned: 0 in 0.841s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-d87c61d2-2daf-4bf7-8a45-09848736e88e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c7fa61c-8ed5-4d7e-8152-680c74b1bd61', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:24:12 devstack sudo[99871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:12 devstack sudo[99871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:12 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-146b88c7-57fc-4ac3-9c81-3a845c8c51b0 req-1f8950b1-400d-4264-baa4-8404b42b3596 tempest-AttachVolumeNegativeTest-820855793 None] attachment_update completed successfully. Jun 23 04:24:12 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:12 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d Jun 23 04:24:12 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:13 devstack sudo[99871]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.944s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Deleted volume successfully. Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3d52adb7-cce3-4f51-a129-761cd15e0c6d tempest-TaggedAttachmentsTest-1787004581 None] Lock "cinder-b9358d55-78a6-484f-a8a9-8e0edc896001-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:13 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2.a55fbbb6-da25-4727-bc07-5d61220c1a2d" returned: 0 in 0.902s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a55fbbb6-da25-4727-bc07-5d61220c1a2d" released by "_delete_snapshot" :: held 3.761s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-8e6c4855-e869-494f-8227-61cd285b47c2" released by "delete_snapshot" :: held 3.806s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:13 devstack cinder-volume[93326]: WARNING cinder.quota [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-464394163 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-464394163, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:24:13 devstack cinder-volume[93326]: WARNING cinder.quota [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-464394163 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-464394163, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['46f59ddd-fdb0-4f5f-9e76-148cf483c01f', 'b42f75cd-02cf-42e7-b2aa-f868a9566906', '1089e1e8-06d7-4c7c-b206-201147302736', '5167f164-27a2-4fa6-be9a-5832fbbbdf74'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:13 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['db6af20a-34b6-4015-99ba-6d9f7a3f6abd', '0c6829b7-e7e8-404e-9644-9cbbf5f58145', '908a620f-e106-48f2-916f-b9f59012ea07', 'f87bc7f1-dc7f-46e8-91df-9e5be6ad08a1'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-687cb9cf-0c48-43ce-a0e4-b04e732f3d90 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot bb3db0a2-fccd-441c-b0f7-83cb6a4360fa: deleted successfully Jun 23 04:24:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-8e6c4855-e869-494f-8227-61cd285b47c2" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-8e6c4855-e869-494f-8227-61cd285b47c2" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3236216b-ea96-40da-a65a-8c33c755036d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:15 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 Jun 23 04:24:15 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:16 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2" returned: 0 in 1.040s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:16 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2 Jun 23 04:24:16 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:17 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e6c4855-e869-494f-8227-61cd285b47c2" returned: 0 in 1.039s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-8e6c4855-e869-494f-8227-61cd285b47c2" released by "delete_volume" :: held 2.196s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-ce585222-67ae-46ed-a198-c0492e142544" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-ce585222-67ae-46ed-a198-c0492e142544" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0851ccc5-cbb4-472e-8024-989baf88b12d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:17 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 Jun 23 04:24:17 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:18 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544" returned: 0 in 1.131s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:18 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544 Jun 23 04:24:18 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:19 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce585222-67ae-46ed-a198-c0492e142544" returned: 0 in 0.764s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-ce585222-67ae-46ed-a198-c0492e142544" released by "delete_volume" :: held 1.990s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['92f5c6c8-28d3-4d77-9e59-f39d4c44b101'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:19 devstack cinder-volume[93326]: WARNING cinder.quota [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-464394163 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-464394163, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['74a05cfb-bd56-4de7-ab5d-a058f706ca66', '3c48b96b-4e87-43f4-8732-e052003e4c22', '4083533b-2906-4d5e-9343-414693c4ee36', '1e0855bf-ee01-4053-b5f0-ee214b1898ac'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['3754ddbb-3d7f-4765-be2d-50cb4cf25d27', '301ed899-d493-40a0-b196-9470e3d0a44f', 'ce09a306-c5c8-4384-b165-dda556eba125', 'fe7ad696-e219-4da6-9ada-8df82c58bdc2'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:19 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:19 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-019dfe57-5e6a-4861-8d46-58eafd368c65 req-399aeafe-e805-4753-8fb9-82b239ba6a93 tempest-AttachVolumeNegativeTest-820855793 None] Terminate volume connection completed successfully. Jun 23 04:24:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-019dfe57-5e6a-4861-8d46-58eafd368c65 req-399aeafe-e805-4753-8fb9-82b239ba6a93 tempest-AttachVolumeNegativeTest-820855793 None] Deleting attachment 0c7fa61c-8ed5-4d7e-8152-680c74b1bd61. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:24:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1b87990e-201e-4e47-ab25-36cfff20fa08 tempest-GroupSnapshotsTest-1192531673 None] Group tempest-GroupSnapshotsTest-Group-677332170: creating Jun 23 04:24:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1b87990e-201e-4e47-ab25-36cfff20fa08 tempest-GroupSnapshotsTest-1192531673 None] Group tempest-GroupSnapshotsTest-Group-677332170: created successfully Jun 23 04:24:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1b87990e-201e-4e47-ab25-36cfff20fa08 tempest-GroupSnapshotsTest-1192531673 None] Create group completed successfully. Jun 23 04:24:20 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.111s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:20 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4a7b2baa-8de2-4776-b4c0-7a6ddf4d0e5c tempest-GroupSnapshotsTest-1192531673 None] Delete group completed successfully. Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (b629a8ff-72d8-4619-9f5f-5c65c0fb6c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a0b4f9-84a6-4ef8-b985-1485e7345117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96a0b4f9-84a6-4ef8-b985-1485e7345117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1172492013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e532d52-d730-4fe6-b50b-2d8dd2f894dd,host='devstack@QuobyteHD#QuobyteHD',id=a277434d-009a-4b4b-a3f5-bc2dc01fc003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:24:22Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a77771-a417-495b-95d6-d13887153233),volume_type_id=72a77771-a417-495b-95d6-d13887153233)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4ea75a-be3d-4361-9cb2-978a35772740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a4ea75a-be3d-4361-9cb2-978a35772740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a64d963-7ff9-415e-9c42-d3dce1cc8019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a64d963-7ff9-415e-9c42-d3dce1cc8019) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a277434d-009a-4b4b-a3f5-bc2dc01fc003', 'volume_name': 'volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d926e6f6-a8f8-4af7-9c34-8bf91833ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d926e6f6-a8f8-4af7-9c34-8bf91833ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae002c1-6d71-451a-a1d7-c867e6ae2f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:22 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Volume a277434d-009a-4b4b-a3f5-bc2dc01fc003: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003', 'volume_size': 1} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2e532d52-d730-4fe6-b50b-2d8dd2f894dd,created_at=2026-06-23T02:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1172492013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2e532d52-d730-4fe6-b50b-2d8dd2f894dd,host='devstack@QuobyteHD#QuobyteHD',id=a277434d-009a-4b4b-a3f5-bc2dc01fc003,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec203087d6f84bba91b1528001c6940e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:24:22Z,use_quota=True,user_id='75440b347bde4c3c9dd9e8cd51e53a02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72a77771-a417-495b-95d6-d13887153233),volume_type_id=72a77771-a417-495b-95d6-d13887153233)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Creating volume a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:24:22 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:24:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:22 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 1073741824 Jun 23 04:24:22 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:23 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 1073741824" returned: 0 in 1.144s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:23 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 Jun 23 04:24:23 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:24 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003" returned: 0 in 0.819s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ae002c1-6d71-451a-a1d7-c867e6ae2f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204639cb-a916-45c0-b6ab-7f33c117a048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:24:24 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Volume volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 (a277434d-009a-4b4b-a3f5-bc2dc01fc003): created successfully Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (204639cb-a916-45c0-b6ab-7f33c117a048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:24:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Flow 'volume_create_manager' (b629a8ff-72d8-4619-9f5f-5c65c0fb6c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:24:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6618cf83-5c00-40f1-8421-bf83c42b9ce5 tempest-GroupSnapshotsTest-1192531673 None] Created volume successfully. Jun 23 04:24:25 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] GroupSnapshot a5790a94-29b5-4c32-8ddb-991e0486cb03: creating. Jun 23 04:24:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Group snapshot a5790a94-29b5-4c32-8ddb-991e0486cb03: creating. {{(pid=93326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 04:24:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Creating offline snapshot 7d876c69-3c20-42c9-9e41-3c1016b055fa of volume a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:24:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40590f4-26bf-4cc6-a8fe-fef4d3c8cbc4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:25 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 Jun 23 04:24:25 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:26 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003" returned: 0 in 0.886s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:26 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa 1G Jun 23 04:24:26 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:27 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa 1G" returned: 0 in 0.927s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:27 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa Jun 23 04:24:27 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:27 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa" returned: 0 in 0.696s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:27 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:24:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:28 devstack sudo[100412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa Jun 23 04:24:28 devstack sudo[100412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:28 devstack sudo[100412]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa" returned: 0 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:28 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=96,cinder:SELECT=104,cinder:INSERT=21,cinder:DELETE=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:24:28 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=90,cinder:SELECT=95,cinder:INSERT=20,cinder:DELETE=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:24:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:28 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info Jun 23 04:24:28 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:29 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info" returned: 0 in 0.736s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:29 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:24:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:29 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info Jun 23 04:24:29 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:30 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.info" returned: 0 in 0.907s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.143s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-998f4b4b-09ae-437d-9c88-e8ed1d19c0bb tempest-GroupSnapshotsTest-1192531673 None] group_snapshot a5790a94-29b5-4c32-8ddb-991e0486cb03: created successfully Jun 23 04:24:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "cinder-d87c61d2-2daf-4bf7-8a45-09848736e88e-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot a5790a94-29b5-4c32-8ddb-991e0486cb03: deleting Jun 23 04:24:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-d87c61d2-2daf-4bf7-8a45-09848736e88e-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot a5790a94-29b5-4c32-8ddb-991e0486cb03: deleting {{(pid=93326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-a277434d-009a-4b4b-a3f5-bc2dc01fc003" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "cinder-quobyte-d87c61d2-2daf-4bf7-8a45-09848736e88e" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a277434d-009a-4b4b-a3f5-bc2dc01fc003" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-7d876c69-3c20-42c9-9e41-3c1016b055fa" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-quobyte-d87c61d2-2daf-4bf7-8a45-09848736e88e" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-7d876c69-3c20-42c9-9e41-3c1016b055fa" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Deleting offline snapshot 7d876c69-3c20-42c9-9e41-3c1016b055fa of volume a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] snapshot_file for this snap is: volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f06dd89-2111-45f4-a6bc-15402ced052c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec15e6b-4939-4f54-b478-f935405859b9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:31 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa Jun 23 04:24:31 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:31 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e Jun 23 04:24:31 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:32 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e" returned: 0 in 1.245s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:32 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa" returned: 0 in 1.203s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:24:32 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e Jun 23 04:24:32 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ac4f25-2519-42f5-8a93-19779a64fe50]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:32 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 Jun 23 04:24:32 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:33 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d87c61d2-2daf-4bf7-8a45-09848736e88e" returned: 0 in 0.884s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-quobyte-d87c61d2-2daf-4bf7-8a45-09848736e88e" released by "delete_volume" :: held 2.279s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:33 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003" returned: 0 in 0.882s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:33 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa Jun 23 04:24:33 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Created reservations ['cce5aca2-ddcc-4f77-8520-13bfa0c164e2', 'b96e6dd0-a424-4faa-afa2-08892750e9dc', '6eebe96f-69ab-4ead-aee3-017bab2ac18f', 'fbd3836f-e1a6-4d9b-a831-78cdd4cb88b9'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:33 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:33 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:34 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.888s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:34 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:34 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Deleted volume successfully. Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa" returned: 0 in 1.122s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:34 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa Jun 23 04:24:34 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-17e7cb1d-c251-4da5-8d60-7c7aa6d490e7 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-d87c61d2-2daf-4bf7-8a45-09848736e88e-delete_volume" released by "delete_volume" :: held 3.598s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "cinder-8ca35e4a-394d-4248-8a14-aafd4ef1057a-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-8ca35e4a-394d-4248-8a14-aafd4ef1057a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "cinder-quobyte-8ca35e4a-394d-4248-8a14-aafd4ef1057a" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-quobyte-8ca35e4a-394d-4248-8a14-aafd4ef1057a" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4cb673-430c-4542-872a-7c180bc39150]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:34 devstack sudo[100496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a Jun 23 04:24:34 devstack sudo[100496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:35 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003.7d876c69-3c20-42c9-9e41-3c1016b055fa" returned: 0 in 0.889s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-7d876c69-3c20-42c9-9e41-3c1016b055fa" released by "_delete_snapshot" :: held 4.337s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a277434d-009a-4b4b-a3f5-bc2dc01fc003" released by "delete_snapshot" :: held 4.395s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:35 devstack cinder-volume[93326]: WARNING cinder.quota [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-207002557 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-207002557, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:24:35 devstack cinder-volume[93326]: WARNING cinder.quota [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-207002557 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-207002557, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:24:35 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['1189b697-418c-4179-ad41-490bdc7ea7cf', '762e6be1-1424-480a-bd66-5509391bbfec', 'd7e11404-391f-47c9-b431-6b1e2c8df51b', '0f74815b-c959-41b3-854d-1eb24dc0ec52'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:35 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-56d512da-59de-402b-964c-a3737222a140 tempest-GroupSnapshotsTest-1192531673 None] group_snapshot a5790a94-29b5-4c32-8ddb-991e0486cb03: deleted successfully Jun 23 04:24:35 devstack sudo[100496]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a" returned: 0 in 1.165s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:35 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a Jun 23 04:24:35 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:36 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8ca35e4a-394d-4248-8a14-aafd4ef1057a" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-quobyte-8ca35e4a-394d-4248-8a14-aafd4ef1057a" released by "delete_volume" :: held 1.889s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Created reservations ['4ec92331-4b36-4e66-ba6a-73fe2c9452e0', '9772cb96-6bec-49b3-a0f4-f86f4d8b21cf', 'f55dcf3f-68ff-4216-a2c8-9e8236718071', 'e19578b2-684e-4973-a896-0a3afd968f18'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:36 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:36 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "cinder-quobyte-a277434d-009a-4b4b-a3f5-bc2dc01fc003" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a277434d-009a-4b4b-a3f5-bc2dc01fc003" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c5345f-d724-4989-af25-f9d5d6a7f812]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "cinder-72022aa3-eb73-4d10-bad3-eb808e7f937a-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-72022aa3-eb73-4d10-bad3-eb808e7f937a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "cinder-quobyte-72022aa3-eb73-4d10-bad3-eb808e7f937a" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-quobyte-72022aa3-eb73-4d10-bad3-eb808e7f937a" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:24:37 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 Jun 23 04:24:37 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f55ec5b-3e31-4d85-b919-4cbe9881d055]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:37 devstack sudo[100510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a Jun 23 04:24:37 devstack sudo[100510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:37 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.040s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Deleted volume successfully. Jun 23 04:24:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c3725bc-b893-4ba4-bbf3-c956fc77f8f2 tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-8ca35e4a-394d-4248-8a14-aafd4ef1057a-delete_volume" released by "delete_volume" :: held 3.198s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:38 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003" returned: 0 in 1.199s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:38 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003 Jun 23 04:24:38 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:38 devstack sudo[100510]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a" returned: 0 in 1.200s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:38 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a Jun 23 04:24:38 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:39 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a277434d-009a-4b4b-a3f5-bc2dc01fc003" returned: 0 in 0.775s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Lock "cinder-quobyte-a277434d-009a-4b4b-a3f5-bc2dc01fc003" released by "delete_volume" :: held 2.086s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['1bb345c8-c7fe-4c94-9edd-48994f8a44b7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:39 devstack cinder-volume[93326]: WARNING cinder.quota [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-207002557 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-207002557, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Created reservations ['f516458a-cdea-40cd-9425-ff6af1dfcd4a', 'a65f722a-b817-4459-a3d7-b2bce8f3f939', 'e4446302-75c9-4ded-b0d0-1d9d0ac07278', 'eef3c0c2-2cae-4080-b14b-bd3a39008feb'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:39 devstack sudo[100529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:39 devstack sudo[100529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:39 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72022aa3-eb73-4d10-bad3-eb808e7f937a" returned: 0 in 1.032s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-quobyte-72022aa3-eb73-4d10-bad3-eb808e7f937a" released by "delete_volume" :: held 2.317s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:39 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Created reservations ['ac491b74-659e-45bd-8d14-90c549ec721d', '10a9e8ed-358d-4fcb-b5fe-f2b653195dc8', '2ec9e006-c72c-4d2d-8968-4d9955f1e4a2', '05361cdc-b936-4c85-be4f-2667a1043a24'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:40 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:40 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:40 devstack sudo[100529]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.053s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:40 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d8a90c1d-0cfe-43d2-9a64-4410d90257d8 tempest-GroupSnapshotsTest-1192531673 None] Delete group completed successfully. Jun 23 04:24:40 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.860s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:40 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Deleted volume successfully. Jun 23 04:24:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1287faf-9174-4d23-8932-92e40deef08c tempest-AttachVolumeNegativeTest-820855793 None] Lock "cinder-72022aa3-eb73-4d10-bad3-eb808e7f937a-delete_volume" released by "delete_volume" :: held 3.587s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:24:49 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=34,cinder:INSERT=10,cinder:UPDATE=49 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:24:50 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=36,cinder:SELECT=33,cinder:INSERT=12,cinder:DELETE=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:24:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:24:54 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:24:54 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:24:55 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jun 23 04:24:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.924s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:24:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:24:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:24:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 8 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:24:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Flow 'volume_create_manager' (aa2486f9-e441-41b6-9aea-2d162087628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fd0f02-c153-456d-974c-9f569d5b5d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4fd0f02-c153-456d-974c-9f569d5b5d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-292912481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b8cacb3c3c40dea367e231d410362e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:02Z,use_quota=True,user_id='f3da817bfbe546acb666c8c2076d0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925db075-b9b7-409e-b1a2-4d657672a206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (925db075-b9b7-409e-b1a2-4d657672a206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02851ffc-c893-4d2f-949f-b381747ee215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02851ffc-c893-4d2f-949f-b381747ee215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650', 'volume_name': 'volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce12a68-9664-473b-9fb2-51e24b8ab89e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fce12a68-9664-473b-9fb2-51e24b8ab89e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ad2ee3-2ba4-450e-81d6-2d08abcec77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:02 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Volume 4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650', 'volume_size': 1} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-292912481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6b8cacb3c3c40dea367e231d410362e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:02Z,use_quota=True,user_id='f3da817bfbe546acb666c8c2076d0a4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Creating volume 4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:02 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:02 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 1073741824 Jun 23 04:25:02 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:04 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 1073741824" returned: 0 in 1.862s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:04 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 Jun 23 04:25:04 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:05 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" returned: 0 in 1.526s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] <== create_volume: return (3492ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.496s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27ad2ee3-2ba4-450e-81d6-2d08abcec77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf4c252-98ab-498a-baf8-611ca1aa7314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Volume volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 (4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650): created successfully Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbf4c252-98ab-498a-baf8-611ca1aa7314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Flow 'volume_create_manager' (aa2486f9-e441-41b6-9aea-2d162087628a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-fd290dba-56b2-4c50-bc1f-db566dc8931b tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Created volume successfully. Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Flow 'volume_create_manager' (2386b0d8-8e46-414b-b436-842ad48b8eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d0fec4-82af-40ba-9430-00a3ea37495c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d0fec4-82af-40ba-9430-00a3ea37495c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-366469562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a1d14b-96e9-4547-827d-76874835c54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50d98324f78431bb132e2dad1517bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:06Z,use_quota=True,user_id='8faccb4281464d17a9fcdbe8fed3324a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c16ddc-c7f8-45db-87f4-d808d10d1608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25c16ddc-c7f8-45db-87f4-d808d10d1608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461ae957-e6ca-46af-9416-5e32d81fdf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (461ae957-e6ca-46af-9416-5e32d81fdf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a1d14b-96e9-4547-827d-76874835c54c', 'volume_name': 'volume-82a1d14b-96e9-4547-827d-76874835c54c', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d205a9d9-2107-4acc-b2c4-36202c9ea0ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d205a9d9-2107-4acc-b2c4-36202c9ea0ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caff187-d662-4333-976b-1b7893e991f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Volume 82a1d14b-96e9-4547-827d-76874835c54c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a1d14b-96e9-4547-827d-76874835c54c', 'volume_size': 1} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-366469562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a1d14b-96e9-4547-827d-76874835c54c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b50d98324f78431bb132e2dad1517bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:06Z,use_quota=True,user_id='8faccb4281464d17a9fcdbe8fed3324a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Creating volume 82a1d14b-96e9-4547-827d-76874835c54c {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:06 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:06 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c 1073741824 Jun 23 04:25:06 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:07 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c 1073741824" returned: 0 in 1.479s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:08 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c Jun 23 04:25:08 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:08 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c" returned: 0 in 0.854s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] <== create_volume: return (2418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.830s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Creating offline snapshot 8ff5d501-f968-4adc-8bad-38f8897f441f of volume 4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caff187-d662-4333-976b-1b7893e991f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a1d14b-96e9-4547-827d-76874835c54c', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3882f27-66f9-4abb-bcc9-2e783cb9d255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[01547f2d-56ee-4923-a8da-2b1d0506bc8e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:09 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Volume volume-82a1d14b-96e9-4547-827d-76874835c54c (82a1d14b-96e9-4547-827d-76874835c54c): created successfully Jun 23 04:25:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3882f27-66f9-4abb-bcc9-2e783cb9d255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Flow 'volume_create_manager' (2386b0d8-8e46-414b-b436-842ad48b8eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e465fcdc-e30a-4d6a-a769-e37d82690bef tempest-VolumesServicesTestJSON-1641106087 None] Created volume successfully. Jun 23 04:25:09 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 Jun 23 04:25:09 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:09 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" returned: 0 in 0.967s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:09 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f 1G Jun 23 04:25:09 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Acquiring lock "cinder-82a1d14b-96e9-4547-827d-76874835c54c-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Lock "cinder-82a1d14b-96e9-4547-827d-76874835c54c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Acquiring lock "cinder-quobyte-82a1d14b-96e9-4547-827d-76874835c54c" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Lock "cinder-quobyte-82a1d14b-96e9-4547-827d-76874835c54c" acquired by "delete_volume" :: waited 0.038s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa6c32b-549a-46bb-8d78-38264f406f47]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:10 devstack sudo[101184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c Jun 23 04:25:10 devstack sudo[101184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:11 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f 1G" returned: 0 in 1.237s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:11 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f Jun 23 04:25:11 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:11 devstack sudo[101184]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c" returned: 0 in 1.308s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:12 devstack sudo[101195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c Jun 23 04:25:12 devstack sudo[101195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:12 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f" returned: 0 in 1.632s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:12 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f is being set with open permissions: ugo+rw Jun 23 04:25:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:12 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f Jun 23 04:25:12 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:13 devstack sudo[101195]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82a1d14b-96e9-4547-827d-76874835c54c" returned: 0 in 1.334s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Lock "cinder-quobyte-82a1d14b-96e9-4547-827d-76874835c54c" released by "delete_volume" :: held 2.730s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Created reservations ['b7b919cb-e732-4157-ade2-194ea6610793', '85b87f4c-9e24-4d4a-a834-5f2c3329ba3a', '453d509f-8185-4b9b-ad89-97cab82c881e', '0baeb0b6-0bcb-4a9d-b8f9-91ebbe534008'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:13 devstack sudo[101205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:25:13 devstack sudo[101205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:15 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f" returned: 0 in 2.401s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:15 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info Jun 23 04:25:15 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:15 devstack sudo[101205]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:15 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:25:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Deleted volume successfully. Jun 23 04:25:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65de104a-2601-48b4-a369-f1734e0c8387 tempest-VolumesServicesTestJSON-1641106087 None] Lock "cinder-82a1d14b-96e9-4547-827d-76874835c54c-delete_volume" released by "delete_volume" :: held 5.086s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:16 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info" returned: 0 in 1.475s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:16 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info is being set with open permissions: ugo+rw Jun 23 04:25:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:16 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info Jun 23 04:25:16 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:18 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.info" returned: 0 in 1.266s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.215s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d3a6a10d-18d5-4fbe-b887-29096a41cea9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Create snapshot completed successfully Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "cinder-8ff5d501-f968-4adc-8bad-38f8897f441f-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-8ff5d501-f968-4adc-8bad-38f8897f441f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "cinder-quobyte-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-quobyte-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "cinder-quobyte-8ff5d501-f968-4adc-8bad-38f8897f441f" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-quobyte-8ff5d501-f968-4adc-8bad-38f8897f441f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Deleting offline snapshot 8ff5d501-f968-4adc-8bad-38f8897f441f of volume 4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] snapshot_file for this snap is: volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9e8a6-1073-4bcd-bd42-1ca44e8c824c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:19 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f Jun 23 04:25:19 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:20 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f" returned: 0 in 0.813s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:25:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b57e94-6dd2-4562-99eb-a96c1d977a9b]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:20 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 Jun 23 04:25:20 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:21 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:21 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f Jun 23 04:25:21 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:21 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f" returned: 0 in 0.811s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:21 devstack sudo[101404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f Jun 23 04:25:21 devstack sudo[101404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:22 devstack sudo[101404]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650.8ff5d501-f968-4adc-8bad-38f8897f441f" returned: 0 in 1.100s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-quobyte-8ff5d501-f968-4adc-8bad-38f8897f441f" released by "_delete_snapshot" :: held 3.659s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-quobyte-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" released by "delete_snapshot" :: held 3.689s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Created reservations ['57e741b2-4f84-4bf1-b29c-47fb3ebb1e1e', '12858ec4-cbba-4148-b8e0-1d9a1af207b9', 'ddc9e09e-d3c1-44f0-bbfd-c4bd1116f7f3', 'd0d4957c-203c-4c90-82d0-956f93dadf67'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:25:23 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Delete snapshot completed successfully. Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7a8453f9-00bc-409e-83c0-5e24eadcd965 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-8ff5d501-f968-4adc-8bad-38f8897f441f-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "cinder-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "cinder-quobyte-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-quobyte-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" acquired by "delete_volume" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de2a03-95cd-439e-876e-ce82790cfcdb]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:24 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 Jun 23 04:25:24 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:25 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" returned: 0 in 1.301s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:25 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650 Jun 23 04:25:25 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:26 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" returned: 0 in 1.189s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-quobyte-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650" released by "delete_volume" :: held 2.604s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Created reservations ['dc5d1885-4c37-4d7d-a76d-faa4f709cc04', '00236374-4368-429a-8037-2839f3038fec', '447d368f-c2e7-4b66-96cb-6d09418fa81a', 'aaec1f83-1b89-47b3-bbfc-50be85d74103'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:26 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:25:26 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:27 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.341s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:28 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:25:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Deleted volume successfully. Jun 23 04:25:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d0572429-574e-4851-8d27-6bdfdfc36172 tempest-VolumeSnapshotQuotasNegativeTestJSON-1132529842 None] Lock "cinder-4dd27e2b-0e4f-48fd-8f2e-6c3ead80e650-delete_volume" released by "delete_volume" :: held 4.342s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Flow 'volume_create_manager' (982aa01c-368a-4aa9-b799-a9e49a244cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b68612-f25b-41e9-9047-bef8c7176cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43b68612-f25b-41e9-9047-bef8c7176cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2059478139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea77153-50c2-4adc-9c51-c242936e3e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd99e4b97546c1818e441b3258f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:31Z,use_quota=True,user_id='aecb1feb542b4a5cb2543e027326a3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035223a5-118b-4812-aa53-a085472ab4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035223a5-118b-4812-aa53-a085472ab4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1094a5-b504-4a22-ac64-5a73052f72cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec1094a5-b504-4a22-ac64-5a73052f72cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eea77153-50c2-4adc-9c51-c242936e3e17', 'volume_name': 'volume-eea77153-50c2-4adc-9c51-c242936e3e17', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba958f9-ec7b-42a7-9235-3aa8087081c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aba958f9-ec7b-42a7-9235-3aa8087081c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59f9b4c-5845-4f01-9ab8-7b46de0f7283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:30 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Volume eea77153-50c2-4adc-9c51-c242936e3e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eea77153-50c2-4adc-9c51-c242936e3e17', 'volume_size': 1} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2059478139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eea77153-50c2-4adc-9c51-c242936e3e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd99e4b97546c1818e441b3258f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:31Z,use_quota=True,user_id='aecb1feb542b4a5cb2543e027326a3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Creating volume eea77153-50c2-4adc-9c51-c242936e3e17 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:30 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:30 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 1073741824 Jun 23 04:25:30 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:32 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 1073741824" returned: 0 in 1.092s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:32 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 Jun 23 04:25:32 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:32 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e59f9b4c-5845-4f01-9ab8-7b46de0f7283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eea77153-50c2-4adc-9c51-c242936e3e17', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ec6d56-3b93-4a37-a992-d36d1ce92066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:32 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Volume volume-eea77153-50c2-4adc-9c51-c242936e3e17 (eea77153-50c2-4adc-9c51-c242936e3e17): created successfully Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ec6d56-3b93-4a37-a992-d36d1ce92066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Flow 'volume_create_manager' (982aa01c-368a-4aa9-b799-a9e49a244cae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0ef76948-3316-48a6-812b-082941f5e034 tempest-AttachVolumeTestJSON-656889715 None] Created volume successfully. Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Flow 'volume_create_manager' (268f1227-d36b-4a28-9a38-217c371714e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012582a8-d1ba-4e7d-83a5-0cd104e3999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (012582a8-d1ba-4e7d-83a5-0cd104e3999a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1106182144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497f4ed7-0616-47fc-8b9c-918573b8ecbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1a00dc2f814b429982bf7e1bbe3771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:35Z,use_quota=True,user_id='c875947ec5e64c6aab60d907b5d5c70d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c098a134-79fa-4c9e-b5d6-9286c18397b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c098a134-79fa-4c9e-b5d6-9286c18397b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b0a370-c29d-427a-b1cb-dda02b80012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b0a370-c29d-427a-b1cb-dda02b80012b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497f4ed7-0616-47fc-8b9c-918573b8ecbf', 'volume_name': 'volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2139bb-bc0e-49f3-99bc-6c653da57c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf2139bb-bc0e-49f3-99bc-6c653da57c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6576a6-d8d5-44bf-bca4-098e59d5e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Volume 497f4ed7-0616-47fc-8b9c-918573b8ecbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf', 'volume_size': 1} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1106182144',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497f4ed7-0616-47fc-8b9c-918573b8ecbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1a00dc2f814b429982bf7e1bbe3771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:35Z,use_quota=True,user_id='c875947ec5e64c6aab60d907b5d5c70d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Creating volume 497f4ed7-0616-47fc-8b9c-918573b8ecbf {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:35 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:35 devstack sudo[101528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf 1073741824 Jun 23 04:25:35 devstack sudo[101528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Flow 'volume_create_manager' (09a5ee8c-a323-496a-acc1-0304ca910faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a90489a-66b8-4760-9f74-da7b5306f13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a90489a-66b8-4760-9f74-da7b5306f13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1506125646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c2cccc-0f75-404c-a316-e6b8a7208956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225e9a4825f449eaff066f07c172bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:36Z,use_quota=True,user_id='b8050c4f379243c7ac4115cec96aa435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f3850a6-dea9-476d-8395-edb8073038f7),volume_type_id=6f3850a6-dea9-476d-8395-edb8073038f7)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf03f3df-d5fb-4ed0-b6b8-919c14f05fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf03f3df-d5fb-4ed0-b6b8-919c14f05fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d612470-d154-4f16-9ec2-3afa3d97a303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d612470-d154-4f16-9ec2-3afa3d97a303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c2cccc-0f75-404c-a316-e6b8a7208956', 'volume_name': 'volume-20c2cccc-0f75-404c-a316-e6b8a7208956', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09d83c6-8824-458d-aa6d-24fac5849e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09d83c6-8824-458d-aa6d-24fac5849e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa712c73-a5e0-40c6-891c-a1c1206c6403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:35 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Volume 20c2cccc-0f75-404c-a316-e6b8a7208956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c2cccc-0f75-404c-a316-e6b8a7208956', 'volume_size': 1} Jun 23 04:25:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:36 devstack sudo[101528]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf 1073741824" returned: 0 in 0.930s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:36 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf Jun 23 04:25:36 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:36 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf" returned: 0 in 0.691s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.187s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1506125646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c2cccc-0f75-404c-a316-e6b8a7208956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225e9a4825f449eaff066f07c172bd2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:36Z,use_quota=True,user_id='b8050c4f379243c7ac4115cec96aa435',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6f3850a6-dea9-476d-8395-edb8073038f7),volume_type_id=6f3850a6-dea9-476d-8395-edb8073038f7)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Creating volume 20c2cccc-0f75-404c-a316-e6b8a7208956 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:36 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f6576a6-d8d5-44bf-bca4-098e59d5e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:37 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 1073741824 Jun 23 04:25:37 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7242eff5-7583-41c8-b609-5cb39cabc2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:37 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Volume volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf (497f4ed7-0616-47fc-8b9c-918573b8ecbf): created successfully Jun 23 04:25:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7242eff5-7583-41c8-b609-5cb39cabc2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Flow 'volume_create_manager' (268f1227-d36b-4a28-9a38-217c371714e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1aa36de7-005c-4ada-a1b4-2b7483747939 tempest-ServersNegativeTestJSON-674764998 None] Created volume successfully. Jun 23 04:25:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:38 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 1073741824" returned: 0 in 1.094s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:38 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 Jun 23 04:25:38 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Flow 'volume_create_manager' (8c395dce-aaa9-41e0-a56c-333e5cdde23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea24062-f211-4b77-86bb-7234c331689e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eea24062-f211-4b77-86bb-7234c331689e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1553713161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a260767-098c-41ea-8510-d7d5878689f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1a00dc2f814b429982bf7e1bbe3771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:39Z,use_quota=True,user_id='c875947ec5e64c6aab60d907b5d5c70d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773f2d17-c3ee-4f14-990c-98de924f4388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773f2d17-c3ee-4f14-990c-98de924f4388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8f0754-ce23-4a16-8cd9-744b681e91fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb8f0754-ce23-4a16-8cd9-744b681e91fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a260767-098c-41ea-8510-d7d5878689f8', 'volume_name': 'volume-2a260767-098c-41ea-8510-d7d5878689f8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911d784d-1f8d-4d16-a4f6-04ec744f0571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (911d784d-1f8d-4d16-a4f6-04ec744f0571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d584245-4daa-47b5-871b-9942282208ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:38 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Volume 2a260767-098c-41ea-8510-d7d5878689f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a260767-098c-41ea-8510-d7d5878689f8', 'volume_size': 1} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:38 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956" returned: 0 in 0.785s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] <== create_volume: return (1928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.931s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.349s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa712c73-a5e0-40c6-891c-a1c1206c6403) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c2cccc-0f75-404c-a316-e6b8a7208956', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67526e9a-212d-447f-ab4f-4574d8bef06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae67bb4-bbd1-4e44-8a2a-421e66d81b9f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:38 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Volume volume-20c2cccc-0f75-404c-a316-e6b8a7208956 (20c2cccc-0f75-404c-a316-e6b8a7208956): created successfully Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67526e9a-212d-447f-ab4f-4574d8bef06a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Flow 'volume_create_manager' (09a5ee8c-a323-496a-acc1-0304ca910faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-80d340df-587f-4376-a9b9-42536ff71d85 tempest-VolumeTypesAccessTest-587915704 None] Created volume successfully. Jun 23 04:25:39 devstack sudo[101557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 Jun 23 04:25:39 devstack sudo[101557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:39 devstack sudo[101557]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17" returned: 0 in 0.794s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.822s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.922s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1553713161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a260767-098c-41ea-8510-d7d5878689f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c1a00dc2f814b429982bf7e1bbe3771',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:39Z,use_quota=True,user_id='c875947ec5e64c6aab60d907b5d5c70d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Creating volume 2a260767-098c-41ea-8510-d7d5878689f8 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:39 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:39 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 1073741824 Jun 23 04:25:39 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-eea77153-50c2-4adc-9c51-c242936e3e17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7722502-f4b2-40a8-bb88-2a422a707e1b', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:25:39 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-35b3a14a-960e-4754-bae5-897943f50081 req-b3c7fb47-82c7-4616-a3e7-4615ee601980 tempest-AttachVolumeTestJSON-656889715 None] attachment_update completed successfully. Jun 23 04:25:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Acquiring lock "cinder-20c2cccc-0f75-404c-a316-e6b8a7208956-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Lock "cinder-20c2cccc-0f75-404c-a316-e6b8a7208956-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Acquiring lock "cinder-quobyte-20c2cccc-0f75-404c-a316-e6b8a7208956" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Lock "cinder-quobyte-20c2cccc-0f75-404c-a316-e6b8a7208956" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12eec358-8634-4cf0-bc96-871b2eba7f65]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:40 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 Jun 23 04:25:40 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:40 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 1073741824" returned: 0 in 0.984s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:40 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 Jun 23 04:25:40 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:41 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956" returned: 0 in 1.122s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:41 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956 Jun 23 04:25:41 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:41 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8" returned: 0 in 1.003s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d584245-4daa-47b5-871b-9942282208ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a260767-098c-41ea-8510-d7d5878689f8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da297139-f3b9-4da2-b1a7-988b55e3b62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:41 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Volume volume-2a260767-098c-41ea-8510-d7d5878689f8 (2a260767-098c-41ea-8510-d7d5878689f8): created successfully Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da297139-f3b9-4da2-b1a7-988b55e3b62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Flow 'volume_create_manager' (8c395dce-aaa9-41e0-a56c-333e5cdde23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ef3190db-3181-4060-bf3d-80318acad953 tempest-ServersNegativeTestJSON-674764998 None] Created volume successfully. Jun 23 04:25:42 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20c2cccc-0f75-404c-a316-e6b8a7208956" returned: 0 in 0.848s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Lock "cinder-quobyte-20c2cccc-0f75-404c-a316-e6b8a7208956" released by "delete_volume" :: held 2.028s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2075226507 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2075226507, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:25:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2075226507 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2075226507, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Created reservations ['3b094f2f-652a-4d7e-852b-f7259acc6206', '8c450bb6-368a-4850-965a-4b345c1e84b2', 'd3b87a25-479a-4d8c-a95d-d87e28c9b394', '53c90dd2-e828-4f12-b73f-699ca71d3f0f'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:42 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:25:42 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:43 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.851s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:25:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Deleted volume successfully. Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4b0adca2-d4a4-413a-9f15-0ff4f6f6edad tempest-VolumeTypesAccessTest-587915704 None] Lock "cinder-20c2cccc-0f75-404c-a316-e6b8a7208956-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "cinder-2a260767-098c-41ea-8510-d7d5878689f8-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-2a260767-098c-41ea-8510-d7d5878689f8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "cinder-quobyte-2a260767-098c-41ea-8510-d7d5878689f8" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-quobyte-2a260767-098c-41ea-8510-d7d5878689f8" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141b930-76ba-408b-bf22-b02f8a2588ea]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:43 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 Jun 23 04:25:43 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:44 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8" returned: 0 in 1.063s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:44 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8 Jun 23 04:25:44 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:45 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2a260767-098c-41ea-8510-d7d5878689f8" returned: 0 in 0.933s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-quobyte-2a260767-098c-41ea-8510-d7d5878689f8" released by "delete_volume" :: held 2.052s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:45 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Created reservations ['68473a16-015a-4b33-beb4-0cd1e3381988', '327e764f-fa54-4be8-bbec-65a2ff2db8f2', '72ca1ad0-1419-4f11-9d0b-119f71c79ab0', '92242723-a287-42d8-ba18-b3fa762364a2'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:46 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:25:46 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Flow 'volume_create_manager' (55d0eaf4-4945-4ad9-864e-bd6c15c413ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7b217a-9908-446f-8753-78937c81f658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc7b217a-9908-446f-8753-78937c81f658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-102864464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5321b136-c947-4a46-a98e-f52cfa923d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd99e4b97546c1818e441b3258f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:46Z,use_quota=True,user_id='aecb1feb542b4a5cb2543e027326a3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7194d4c-9f93-4a7c-a97b-6544e6f9f2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7194d4c-9f93-4a7c-a97b-6544e6f9f2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317e6779-d5c1-4ac3-a36c-b9fbca3bc370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (317e6779-d5c1-4ac3-a36c-b9fbca3bc370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5321b136-c947-4a46-a98e-f52cfa923d7f', 'volume_name': 'volume-5321b136-c947-4a46-a98e-f52cfa923d7f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84299437-75b0-4238-a2d5-312f8e945b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84299437-75b0-4238-a2d5-312f8e945b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db9f299-d36b-44e1-b530-06202cf9a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Volume 5321b136-c947-4a46-a98e-f52cfa923d7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5321b136-c947-4a46-a98e-f52cfa923d7f', 'volume_size': 1} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-102864464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5321b136-c947-4a46-a98e-f52cfa923d7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04fd99e4b97546c1818e441b3258f69d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:25:46Z,use_quota=True,user_id='aecb1feb542b4a5cb2543e027326a3b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Creating volume 5321b136-c947-4a46-a98e-f52cfa923d7f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:25:46 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:46 devstack sudo[101985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f 1073741824 Jun 23 04:25:46 devstack sudo[101985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:46 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.872s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:25:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Deleted volume successfully. Jun 23 04:25:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98ab2e62-bad6-4cf0-bd1e-58dcd55d4cfa tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-2a260767-098c-41ea-8510-d7d5878689f8-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "cinder-497f4ed7-0616-47fc-8b9c-918573b8ecbf-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-497f4ed7-0616-47fc-8b9c-918573b8ecbf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "cinder-quobyte-497f4ed7-0616-47fc-8b9c-918573b8ecbf" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-quobyte-497f4ed7-0616-47fc-8b9c-918573b8ecbf" acquired by "delete_volume" :: waited 0.036s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0a4739-e892-4cce-8308-9700a1a2dc9a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:47 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf Jun 23 04:25:47 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:47 devstack sudo[101985]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f 1073741824" returned: 0 in 1.177s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:47 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f Jun 23 04:25:47 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:48 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf" returned: 0 in 1.140s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:48 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf Jun 23 04:25:48 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:48 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f" returned: 0 in 1.025s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] <== create_volume: return (2271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db9f299-d36b-44e1-b530-06202cf9a57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5321b136-c947-4a46-a98e-f52cfa923d7f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f8617c-ecbf-49ee-b4e8-f9136f1adde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:25:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Volume volume-5321b136-c947-4a46-a98e-f52cfa923d7f (5321b136-c947-4a46-a98e-f52cfa923d7f): created successfully Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f8617c-ecbf-49ee-b4e8-f9136f1adde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:25:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Flow 'volume_create_manager' (55d0eaf4-4945-4ad9-864e-bd6c15c413ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:25:48 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2189071c-6b20-45f2-ac87-2b4517c33aeb tempest-AttachVolumeTestJSON-656889715 None] Created volume successfully. Jun 23 04:25:49 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-497f4ed7-0616-47fc-8b9c-918573b8ecbf" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-quobyte-497f4ed7-0616-47fc-8b9c-918573b8ecbf" released by "delete_volume" :: held 1.962s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Created reservations ['00630906-7cee-4385-9f98-edd9e788fb76', 'dbfb84dc-e11e-4d04-9159-ae80f95490a8', 'dde2ed50-e616-47c6-8cdb-0100ebba0ab0', '0fc29bf6-f7ce-4294-8c74-5e632e6267f6'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:49 devstack sudo[102004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:25:49 devstack sudo[102004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:50 devstack sudo[102004]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.189s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:50 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:25:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Deleted volume successfully. Jun 23 04:25:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dbc9b6f1-c00b-412c-9e08-89239dae1940 tempest-ServersNegativeTestJSON-674764998 None] Lock "cinder-497f4ed7-0616-47fc-8b9c-918573b8ecbf-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:25:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:52 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c007d95-f848-444f-b0b4-2fe1450a3166]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:25:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:52 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f Jun 23 04:25:52 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:53 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f" returned: 0 in 1.226s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.251s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-5321b136-c947-4a46-a98e-f52cfa923d7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95b51973-3aeb-4200-98d9-147b197527ff', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:25:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-33224d55-8862-4c93-aa26-170d15da2805 req-4a69ae7c-5009-4ff7-adec-5cbf4230319e tempest-AttachVolumeTestJSON-656889715 None] attachment_update completed successfully. Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:25:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:25:54 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:25:54 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:25:55 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jun 23 04:25:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.994s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:25:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:25:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:25:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 8 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:25:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Flow 'volume_create_manager' (e96d1797-d3f4-422d-8f70-4081def392d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0447fce7-782f-49a1-a359-57cb6a70a268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0447fce7-782f-49a1-a359-57cb6a70a268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-704089822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0c336-35a0-437d-b2e6-cf3c6503e2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72a1f2484aa44b7ace3615b2ad9bf49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:00Z,use_quota=True,user_id='b9c80f643de74d58a11c97ae935746a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91089fff-6ccd-4ebe-aed0-f578f6d3d560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91089fff-6ccd-4ebe-aed0-f578f6d3d560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda48b38-5f21-4f3c-af96-98ae187fed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bda48b38-5f21-4f3c-af96-98ae187fed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07a0c336-35a0-437d-b2e6-cf3c6503e2e8', 'volume_name': 'volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ade5cc1-a39c-43c7-80c8-50b186f74848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ade5cc1-a39c-43c7-80c8-50b186f74848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51ab6b4-2828-4321-bdd4-e927117f09c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Volume 07a0c336-35a0-437d-b2e6-cf3c6503e2e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8', 'volume_size': 1} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-704089822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07a0c336-35a0-437d-b2e6-cf3c6503e2e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72a1f2484aa44b7ace3615b2ad9bf49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:00Z,use_quota=True,user_id='b9c80f643de74d58a11c97ae935746a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Creating volume 07a0c336-35a0-437d-b2e6-cf3c6503e2e8 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:00 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:00 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 1073741824 Jun 23 04:26:00 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:01 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=70,cinder:SELECT=63,cinder:DELETE=8,cinder:INSERT=11 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:26:01 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=59,cinder:UPDATE=73,cinder:INSERT=21,cinder:DELETE=5 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:26:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-8fa9d09f-d5db-4a15-80e8-76a2c960ef06 req-54166611-ced1-4cf9-8f2c-97842a400c82 tempest-AttachVolumeTestJSON-656889715 None] Terminate volume connection completed successfully. Jun 23 04:26:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-8fa9d09f-d5db-4a15-80e8-76a2c960ef06 req-54166611-ced1-4cf9-8f2c-97842a400c82 tempest-AttachVolumeTestJSON-656889715 None] Deleting attachment f7722502-f4b2-40a8-bb88-2a422a707e1b. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:26:01 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 1073741824" returned: 0 in 1.231s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:01 devstack sudo[102153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 Jun 23 04:26:01 devstack sudo[102153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:02 devstack sudo[102153]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8" returned: 0 in 0.955s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] <== create_volume: return (2229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51ab6b4-2828-4321-bdd4-e927117f09c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7c4d65-fa2a-4de3-a8e0-4110d697884a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:02 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Volume volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 (07a0c336-35a0-437d-b2e6-cf3c6503e2e8): created successfully Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7c4d65-fa2a-4de3-a8e0-4110d697884a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Flow 'volume_create_manager' (e96d1797-d3f4-422d-8f70-4081def392d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-380c9fa7-4ef2-4796-a95f-bf19a2d9e078 tempest-VolumesTransfersV355Test-2011176817 None] Created volume successfully. Jun 23 04:26:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-7bf5ef9a-e846-44c4-aaf2-4b290d7b4453 req-95f665b7-59ae-4715-830f-e0c1811f128f tempest-AttachVolumeTestJSON-656889715 None] Terminate volume connection completed successfully. Jun 23 04:26:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-7bf5ef9a-e846-44c4-aaf2-4b290d7b4453 req-95f665b7-59ae-4715-830f-e0c1811f128f tempest-AttachVolumeTestJSON-656889715 None] Deleting attachment 95b51973-3aeb-4200-98d9-147b197527ff. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:26:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-05be7db5-b1b6-40e9-989a-9316213a49db tempest-VolumesTransfersV355Test-1644049424 None] Transfer volume completed successfully. Jun 23 04:26:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Acquiring lock "cinder-07a0c336-35a0-437d-b2e6-cf3c6503e2e8-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-07a0c336-35a0-437d-b2e6-cf3c6503e2e8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Acquiring lock "cinder-quobyte-07a0c336-35a0-437d-b2e6-cf3c6503e2e8" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-quobyte-07a0c336-35a0-437d-b2e6-cf3c6503e2e8" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[647f8a2f-800c-4e31-8d53-e4f26a04b9e1]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:05 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 Jun 23 04:26:05 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:06 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8" returned: 0 in 0.890s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:06 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8 Jun 23 04:26:06 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:07 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-07a0c336-35a0-437d-b2e6-cf3c6503e2e8" returned: 0 in 0.709s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-quobyte-07a0c336-35a0-437d-b2e6-cf3c6503e2e8" released by "delete_volume" :: held 1.650s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Created reservations ['d3ae88c8-9d2d-42c1-b0f4-339f2e503979', '9450c7cb-718b-4609-9296-3db1c7910148', 'eff212f6-4c19-44b4-908c-5a1b0945c0e1', 'ec92f1ed-ddfc-43a8-a403-140bbdefd4d7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:07 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:07 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:08 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.202s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Deleted volume successfully. Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2e7b6c9b-1b29-45cc-92ca-1a07b064a06f tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-07a0c336-35a0-437d-b2e6-cf3c6503e2e8-delete_volume" released by "delete_volume" :: held 3.258s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Flow 'volume_create_manager' (492633af-d1f2-4fb6-a32d-416481c60dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bc9831-f7c5-49fe-be05-fdba7d77a257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42bc9831-f7c5-49fe-be05-fdba7d77a257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1627412838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d1fc7a-7da3-4d10-b631-bdef1186975d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72a1f2484aa44b7ace3615b2ad9bf49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:09Z,use_quota=True,user_id='b9c80f643de74d58a11c97ae935746a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7782b41f-96f9-45f7-8e63-4c266274e4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7782b41f-96f9-45f7-8e63-4c266274e4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1066915e-bf35-4e7d-86fc-e8c8c266e436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1066915e-bf35-4e7d-86fc-e8c8c266e436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d1fc7a-7da3-4d10-b631-bdef1186975d', 'volume_name': 'volume-54d1fc7a-7da3-4d10-b631-bdef1186975d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af9e1b-aeaf-4e5b-a1b9-add96dc9c24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af9e1b-aeaf-4e5b-a1b9-add96dc9c24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a72085a-91f7-4476-901d-07d64860322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:08 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Volume 54d1fc7a-7da3-4d10-b631-bdef1186975d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d1fc7a-7da3-4d10-b631-bdef1186975d', 'volume_size': 1} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1627412838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d1fc7a-7da3-4d10-b631-bdef1186975d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72a1f2484aa44b7ace3615b2ad9bf49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:09Z,use_quota=True,user_id='b9c80f643de74d58a11c97ae935746a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Creating volume 54d1fc7a-7da3-4d10-b631-bdef1186975d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:08 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:09 devstack sudo[102220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d 1073741824 Jun 23 04:26:09 devstack sudo[102220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:10 devstack sudo[102220]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d 1073741824" returned: 0 in 1.235s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:10 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d Jun 23 04:26:10 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:11 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d" returned: 0 in 0.790s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a72085a-91f7-4476-901d-07d64860322c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d1fc7a-7da3-4d10-b631-bdef1186975d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165f2e81-a29c-4877-be40-1300940d9007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:11 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Volume volume-54d1fc7a-7da3-4d10-b631-bdef1186975d (54d1fc7a-7da3-4d10-b631-bdef1186975d): created successfully Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165f2e81-a29c-4877-be40-1300940d9007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Flow 'volume_create_manager' (492633af-d1f2-4fb6-a32d-416481c60dc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-eb691533-e316-4206-aa8d-50196720c469 tempest-VolumesTransfersV355Test-2011176817 None] Created volume successfully. Jun 23 04:26:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Acquiring lock "cinder-54d1fc7a-7da3-4d10-b631-bdef1186975d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-54d1fc7a-7da3-4d10-b631-bdef1186975d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Acquiring lock "cinder-quobyte-54d1fc7a-7da3-4d10-b631-bdef1186975d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-quobyte-54d1fc7a-7da3-4d10-b631-bdef1186975d" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edb358c-4bb8-416e-a082-732676685031]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:12 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d Jun 23 04:26:12 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:13 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d" returned: 0 in 0.887s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:13 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d Jun 23 04:26:13 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:14 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-54d1fc7a-7da3-4d10-b631-bdef1186975d" returned: 0 in 0.737s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-quobyte-54d1fc7a-7da3-4d10-b631-bdef1186975d" released by "delete_volume" :: held 1.668s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Created reservations ['5ec8e906-f820-4016-86e1-ca7a5073caf7', '5fa0365d-3f55-40e9-8401-ae75f994c77b', 'e9b2cc64-f01e-499b-95b8-b5801dcc4b18', '5856215b-06f6-4ec8-8a1a-be905d48ddb1'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:14 devstack sudo[102260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:14 devstack sudo[102260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:15 devstack sudo[102260]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.890s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:15 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Deleted volume successfully. Jun 23 04:26:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0ef1a64f-d639-49a7-a9ff-1961f70d6199 tempest-VolumesTransfersV355Test-243282236 None] Lock "cinder-54d1fc7a-7da3-4d10-b631-bdef1186975d-delete_volume" released by "delete_volume" :: held 2.822s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "cinder-5321b136-c947-4a46-a98e-f52cfa923d7f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-5321b136-c947-4a46-a98e-f52cfa923d7f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "cinder-quobyte-5321b136-c947-4a46-a98e-f52cfa923d7f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-quobyte-5321b136-c947-4a46-a98e-f52cfa923d7f" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[558db1f9-8c58-4f11-944d-c17c6df407a0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:16 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f Jun 23 04:26:16 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:18 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f" returned: 0 in 1.225s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:18 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f Jun 23 04:26:18 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:19 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5321b136-c947-4a46-a98e-f52cfa923d7f" returned: 0 in 1.362s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-quobyte-5321b136-c947-4a46-a98e-f52cfa923d7f" released by "delete_volume" :: held 2.664s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Created reservations ['06f344bd-274d-4fa4-ba97-a3637e611aa4', '4e0231a5-98c1-4775-ab60-33c75d4167e0', '50eb944f-60d5-4eec-9269-aff8b10479a7', '119fb7dc-6b7d-4d32-a836-6fb500dba63b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:19 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:19 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "cinder-eea77153-50c2-4adc-9c51-c242936e3e17-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-eea77153-50c2-4adc-9c51-c242936e3e17-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "cinder-quobyte-eea77153-50c2-4adc-9c51-c242936e3e17" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-quobyte-eea77153-50c2-4adc-9c51-c242936e3e17" acquired by "delete_volume" :: waited 0.042s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[033098bd-86b3-4928-8c21-f62d492f4f8c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:20 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 Jun 23 04:26:20 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:21 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:21 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:21 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Deleted volume successfully. Jun 23 04:26:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e38b50b4-a7f1-4111-89fe-85d70471bad1 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-5321b136-c947-4a46-a98e-f52cfa923d7f-delete_volume" released by "delete_volume" :: held 4.704s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:22 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17" returned: 0 in 1.713s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:22 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17 Jun 23 04:26:22 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:23 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eea77153-50c2-4adc-9c51-c242936e3e17" returned: 0 in 1.410s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-quobyte-eea77153-50c2-4adc-9c51-c242936e3e17" released by "delete_volume" :: held 3.226s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (ae0342d0-3b61-46ce-b0d9-90cfafce7a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5d5d49-ce68-4589-8951-b8d111b64827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5d5d49-ce68-4589-8951-b8d111b64827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211669500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:24Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70321fb2-2f81-4a11-92a5-cbf817317bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70321fb2-2f81-4a11-92a5-cbf817317bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509f1dd9-645d-4b96-aa96-696413a7be15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (509f1dd9-645d-4b96-aa96-696413a7be15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd', 'volume_name': 'volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c21ff7-0c80-47a3-9963-5a105d85f3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35c21ff7-0c80-47a3-9963-5a105d85f3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a755eb37-8d75-45e7-bfc7-2fa611602530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:23 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Volume 3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd', 'volume_size': 1} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1211669500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:24Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Creating volume 3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:23 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:23 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Created reservations ['9a27101a-97f1-4695-be91-3938d9c39329', 'c919ef87-ccb4-4401-bb86-2a1afb402c0c', '290a4dd8-1c17-4aba-81d8-bf172d6664d5', '2b32dd8d-de8a-4bf2-98eb-0d33821cae17'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:23 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd 1073741824 Jun 23 04:26:23 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:24 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:24 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:24 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:24 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:25 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "cinder-9a3e69a7-20b1-4865-aed6-b6a4d401f255-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd 1073741824" returned: 0 in 1.503s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-9a3e69a7-20b1-4865-aed6-b6a4d401f255-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:25 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd Jun 23 04:26:25 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "cinder-quobyte-9a3e69a7-20b1-4865-aed6-b6a4d401f255" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-quobyte-9a3e69a7-20b1-4865-aed6-b6a4d401f255" acquired by "delete_volume" :: waited 0.059s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d485d35-410f-408c-a421-ae5b6f14dd88]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:26 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.897s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:26 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Deleted volume successfully. Jun 23 04:26:26 devstack sudo[102392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 Jun 23 04:26:26 devstack sudo[102392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5b592fac-a3bf-4e18-b21d-bc8bd353359e tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-eea77153-50c2-4adc-9c51-c242936e3e17-delete_volume" released by "delete_volume" :: held 5.739s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:26 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" returned: 0 in 1.504s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] <== create_volume: return (3077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.081s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a755eb37-8d75-45e7-bfc7-2fa611602530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c572b1e-261f-42b9-bfe4-8e48589e9823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:27 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Volume volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd (3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd): created successfully Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c572b1e-261f-42b9-bfe4-8e48589e9823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (ae0342d0-3b61-46ce-b0d9-90cfafce7a44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:27 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f88958f6-447d-4a1d-a35e-6b480a853dc7 tempest-VolumesActionsTest-775901096 None] Created volume successfully. Jun 23 04:26:27 devstack sudo[102392]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255" returned: 0 in 1.591s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:27 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255 Jun 23 04:26:27 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ec37f463-ab23-4782-b77a-6eaf42a52ab9 tempest-VolumesActionsTest-775901096 None] Acquiring lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" by "attach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ec37f463-ab23-4782-b77a-6eaf42a52ab9 tempest-VolumesActionsTest-775901096 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" acquired by "attach_volume" :: waited 0.044s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:28 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a3e69a7-20b1-4865-aed6-b6a4d401f255" returned: 0 in 1.211s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-quobyte-9a3e69a7-20b1-4865-aed6-b6a4d401f255" released by "delete_volume" :: held 2.910s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ec37f463-ab23-4782-b77a-6eaf42a52ab9 tempest-VolumesActionsTest-775901096 None] Attaching volume 3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd to instance 00ba4b40-d823-43cb-a34e-13feddd00f11 at mountpoint /dev/vdb on host None. Jun 23 04:26:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ec37f463-ab23-4782-b77a-6eaf42a52ab9 tempest-VolumesActionsTest-775901096 None] Attach volume completed successfully. Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Created reservations ['ec8b680a-8c7e-4d02-81c5-82a044ae1fda', '8c890813-60b6-4674-b974-10690d65a67c', '9df974fd-89b7-49a2-a741-7422aa350890', '461e86bb-b81a-4c81-8049-2754c00b17c1'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ec37f463-ab23-4782-b77a-6eaf42a52ab9 tempest-VolumesActionsTest-775901096 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" released by "attach_volume" :: held 0.226s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:28 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:28 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:30 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.259s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:30 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Deleted volume successfully. Jun 23 04:26:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c13ca9fa-1734-4495-b7c9-cbc665713ae2 tempest-AttachVolumeTestJSON-656889715 None] Lock "cinder-9a3e69a7-20b1-4865-aed6-b6a4d401f255-delete_volume" released by "delete_volume" :: held 4.688s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be99b387-9c05-48de-8461-9315952f2693 tempest-VolumesActionsTest-1659149944 None] Terminate volume connection completed successfully. Jun 23 04:26:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-be99b387-9c05-48de-8461-9315952f2693 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-detach_volume" by "detach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-be99b387-9c05-48de-8461-9315952f2693 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be99b387-9c05-48de-8461-9315952f2693 tempest-VolumesActionsTest-1659149944 None] Detaching volume 3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd from instance 00ba4b40-d823-43cb-a34e-13feddd00f11. Jun 23 04:26:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be99b387-9c05-48de-8461-9315952f2693 tempest-VolumesActionsTest-1659149944 None] Detach volume completed successfully. Jun 23 04:26:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-be99b387-9c05-48de-8461-9315952f2693 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-detach_volume" released by "detach_volume" :: held 0.102s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ff67e0be-5ada-43f7-bca1-2b4bdafb7405 tempest-VolumesActionsTest-775901096 None] Acquiring lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-detach_volume" by "detach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ff67e0be-5ada-43f7-bca1-2b4bdafb7405 tempest-VolumesActionsTest-775901096 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ff67e0be-5ada-43f7-bca1-2b4bdafb7405 tempest-VolumesActionsTest-775901096 None] Volume detach called, but volume not attached. Jun 23 04:26:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ff67e0be-5ada-43f7-bca1-2b4bdafb7405 tempest-VolumesActionsTest-775901096 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Acquiring lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Acquiring lock "cinder-quobyte-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Lock "cinder-quobyte-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbad538-c5b2-41c6-8f3d-9a9ef1febf6d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:32 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd Jun 23 04:26:32 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:33 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" returned: 0 in 1.117s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:33 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd Jun 23 04:26:33 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:34 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" returned: 0 in 0.704s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Lock "cinder-quobyte-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd" released by "delete_volume" :: held 1.877s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Created reservations ['6d59316d-15da-454a-9cf5-326eee67c28f', 'b786c789-e10c-4040-b49e-63cf013155de', '2ca2ec45-5cd4-480a-9d94-dfad6920f3db', 'ad853e9d-3ce1-499f-b20c-d381d58893aa'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:34 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:34 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:35 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:35 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:35 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Deleted volume successfully. Jun 23 04:26:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c1160a9f-8c0f-4b5f-a720-a26ce0b648f3 tempest-VolumesActionsTest-775901096 None] Lock "cinder-3a02acd4-5a0a-4cd8-ba2f-3018569b6bfd-delete_volume" released by "delete_volume" :: held 2.911s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Flow 'volume_create_manager' (60a8b7e7-db14-432f-beba-afb96a22086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fdbbdd-060a-4668-811f-fe72b0acca79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fdbbdd-060a-4668-811f-fe72b0acca79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1134750661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09834b4-9a56-4ed1-81ea-976c59f8a98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02da0c74c7c04b25911e4a9728164cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:39Z,use_quota=True,user_id='ba0c69ff64a842df8a12e9d01e76fb8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e56fbbb-1666-48bd-b789-e707bfc4c201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e56fbbb-1666-48bd-b789-e707bfc4c201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f804fc-ab54-4322-9282-c14b4a5c7553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f804fc-ab54-4322-9282-c14b4a5c7553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09834b4-9a56-4ed1-81ea-976c59f8a98e', 'volume_name': 'volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ddf845-6473-46d8-88bc-0d35c86e45b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61ddf845-6473-46d8-88bc-0d35c86e45b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe10123-0bac-4ce4-a8a0-d319358ccd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:39 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Volume b09834b4-9a56-4ed1-81ea-976c59f8a98e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e', 'volume_size': 1} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1134750661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09834b4-9a56-4ed1-81ea-976c59f8a98e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02da0c74c7c04b25911e4a9728164cba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:39Z,use_quota=True,user_id='ba0c69ff64a842df8a12e9d01e76fb8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Creating volume b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:39 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:39 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e 1073741824 Jun 23 04:26:39 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:40 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e 1073741824" returned: 0 in 1.145s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:40 devstack sudo[102501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:26:40 devstack sudo[102501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:41 devstack sudo[102501]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.692s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] <== create_volume: return (1904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbe10123-0bac-4ce4-a8a0-d319358ccd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68655ad-2ad6-44d8-8e48-d08546b042af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:41 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Volume volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e (b09834b4-9a56-4ed1-81ea-976c59f8a98e): created successfully Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e68655ad-2ad6-44d8-8e48-d08546b042af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Flow 'volume_create_manager' (60a8b7e7-db14-432f-beba-afb96a22086d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9df71a0a-5e81-4a93-b52f-110cdd4a1d69 tempest-VolumesActionsTest-1613227002 None] Created volume successfully. Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Flow 'volume_create_manager' (7fff9f23-4e82-45d4-8184-ae0cbf0fdf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6c7329-e668-4772-8e02-8f34db724092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6c7329-e668-4772-8e02-8f34db724092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1803353274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478bb3ac-fe56-41f0-ade9-87fa56f7fa78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f69834e9e5b47f2ab66595c4755c919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:43Z,use_quota=True,user_id='93acde65b932460695c5641ef7e607ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d5421-b74a-4761-af04-116f7def47b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645d5421-b74a-4761-af04-116f7def47b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6112b5f5-ad6f-46c0-902a-64e11f84ee85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6112b5f5-ad6f-46c0-902a-64e11f84ee85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '478bb3ac-fe56-41f0-ade9-87fa56f7fa78', 'volume_name': 'volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db862589-dd7f-43a6-a6d0-90d71b370ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db862589-dd7f-43a6-a6d0-90d71b370ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c0dbab-f12e-438f-8527-9e60b392ea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:42 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Volume 478bb3ac-fe56-41f0-ade9-87fa56f7fa78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78', 'volume_size': 1} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1803353274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=478bb3ac-fe56-41f0-ade9-87fa56f7fa78,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4f69834e9e5b47f2ab66595c4755c919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:43Z,use_quota=True,user_id='93acde65b932460695c5641ef7e607ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Creating volume 478bb3ac-fe56-41f0-ade9-87fa56f7fa78 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:42 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:42 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 1073741824 Jun 23 04:26:42 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:43 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 1073741824" returned: 0 in 0.942s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:43 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 Jun 23 04:26:43 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:44 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78" returned: 0 in 0.710s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.699s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (871dbbbf-1706-4c2f-b229-018e3a52e173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b97b981-4c3d-4670-90b5-1c2964ed925b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c0dbab-f12e-438f-8527-9e60b392ea69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5073b504-02a7-4585-9e44-579215a36ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b97b981-4c3d-4670-90b5-1c2964ed925b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2061559982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531eca99-5cbd-4334-a3a1-5a7c21083dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:45Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05b872c-16d9-417b-bb0b-28954cacde4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05b872c-16d9-417b-bb0b-28954cacde4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a0676c-3a90-4a27-8429-a60e82d763a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47a0676c-3a90-4a27-8429-a60e82d763a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '531eca99-5cbd-4334-a3a1-5a7c21083dc8', 'volume_name': 'volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1eae9d-961a-4efb-9096-efaa4649cb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b1eae9d-961a-4efb-9096-efaa4649cb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b74fb19-32fc-4c79-ba85-ecf660d8232c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Volume 531eca99-5cbd-4334-a3a1-5a7c21083dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8', 'volume_size': 1} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2061559982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=531eca99-5cbd-4334-a3a1-5a7c21083dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:45Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Creating volume 531eca99-5cbd-4334-a3a1-5a7c21083dc8 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:44 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Volume volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 (478bb3ac-fe56-41f0-ade9-87fa56f7fa78): created successfully Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5073b504-02a7-4585-9e44-579215a36ad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:44 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 1073741824 Jun 23 04:26:44 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Flow 'volume_create_manager' (7fff9f23-4e82-45d4-8184-ae0cbf0fdf89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:44 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-98d82647-4154-4449-a6da-8a14f22e3211 req-d2aad832-fb78-4d62-96bc-8de38a935ba5 tempest-VolumesGetTestJSON-1682194269 None] Created volume successfully. Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Acquiring lock "cinder-478bb3ac-fe56-41f0-ade9-87fa56f7fa78-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Lock "cinder-478bb3ac-fe56-41f0-ade9-87fa56f7fa78-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Acquiring lock "cinder-quobyte-478bb3ac-fe56-41f0-ade9-87fa56f7fa78" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Lock "cinder-quobyte-478bb3ac-fe56-41f0-ade9-87fa56f7fa78" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7705532e-5d3e-421e-8ccc-33236da9ca79]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:45 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 Jun 23 04:26:45 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:45 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 1073741824" returned: 0 in 0.980s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:45 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 Jun 23 04:26:45 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:46 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78" returned: 0 in 1.026s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:46 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78 Jun 23 04:26:46 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:46 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8" returned: 0 in 1.024s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] <== create_volume: return (2068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b74fb19-32fc-4c79-ba85-ecf660d8232c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992f6a20-7e88-4a82-b71f-8935dd792ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Volume volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 (531eca99-5cbd-4334-a3a1-5a7c21083dc8): created successfully Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992f6a20-7e88-4a82-b71f-8935dd792ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (871dbbbf-1706-4c2f-b229-018e3a52e173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-30ae1a21-083f-4450-b4c3-a27d5e3013c5 tempest-VolumesActionsTest-775901096 None] Created volume successfully. Jun 23 04:26:47 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-478bb3ac-fe56-41f0-ade9-87fa56f7fa78" returned: 0 in 0.944s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Lock "cinder-quobyte-478bb3ac-fe56-41f0-ade9-87fa56f7fa78" released by "delete_volume" :: held 2.038s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG cinder.quota [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Created reservations ['dbdc6f9d-c88e-425d-972f-9067ea0b729a', 'f179e73a-91a4-4769-88e7-96d019857280', 'ffff2f37-7259-46f4-9b81-8a64236f96a6', '04b3fe93-fbf1-4270-b169-8eb50f871e65'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:47 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:47 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-531eca99-5cbd-4334-a3a1-5a7c21083dc8-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Lock "cinder-531eca99-5cbd-4334-a3a1-5a7c21083dc8-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-quobyte-531eca99-5cbd-4334-a3a1-5a7c21083dc8" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-531eca99-5cbd-4334-a3a1-5a7c21083dc8" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d8223-a0ac-4d58-960c-36cffd56ed2d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:48 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.977s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG cinder.manager [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:48 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Deleted volume successfully. Jun 23 04:26:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-356a7d7a-b457-44d4-bad2-d1c22b2845de req-e5d2bdab-82e0-492c-bcef-2235ec184690 tempest-VolumesGetTestJSON-1682194269 None] Lock "cinder-478bb3ac-fe56-41f0-ade9-87fa56f7fa78-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:48 devstack sudo[102563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 Jun 23 04:26:48 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:49 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8" returned: 0 in 0.941s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:49 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8 Jun 23 04:26:49 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:50 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-531eca99-5cbd-4334-a3a1-5a7c21083dc8" returned: 0 in 0.755s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-531eca99-5cbd-4334-a3a1-5a7c21083dc8" released by "delete_volume" :: held 1.772s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Created reservations ['e6b0bfb9-77f1-46bf-9611-786bd9c88334', '947ff481-6de4-4f42-9b0f-7fbf8d1fb3ce', 'f80604b0-70c6-4399-a791-eeb6def19d69', '3ea03fa3-9786-41a1-b823-c6a346f31ebc'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:50 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:50 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:51 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.798s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Deleted volume successfully. Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9c67db3e-4610-48ad-aaaf-75dac7514f5f tempest-VolumesActionsTest-1659149944 None] Lock "cinder-531eca99-5cbd-4334-a3a1-5a7c21083dc8-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (e7d075a8-a1fd-43c3-afe0-194ca50328ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092b0294-f714-4fb2-9d96-59725f462cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (092b0294-f714-4fb2-9d96-59725f462cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1863835177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a7bbab-3458-498d-b9c1-5309c456e96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:51Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce673d5b-f646-46d4-abd7-1511d3150a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce673d5b-f646-46d4-abd7-1511d3150a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526d3858-bfdf-4248-97b4-91bab0873fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526d3858-bfdf-4248-97b4-91bab0873fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21a7bbab-3458-498d-b9c1-5309c456e96d', 'volume_name': 'volume-21a7bbab-3458-498d-b9c1-5309c456e96d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f849164-3ff0-48b2-9320-ddf039a0a216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f849164-3ff0-48b2-9320-ddf039a0a216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5064dec6-c8f2-4978-9e19-cca58b5b8918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Volume 21a7bbab-3458-498d-b9c1-5309c456e96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21a7bbab-3458-498d-b9c1-5309c456e96d', 'volume_size': 1} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1863835177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21a7bbab-3458-498d-b9c1-5309c456e96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:51Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Creating volume 21a7bbab-3458-498d-b9c1-5309c456e96d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:51 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:51 devstack sudo[102591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d 1073741824 Jun 23 04:26:51 devstack sudo[102591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:52 devstack sudo[102591]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d 1073741824" returned: 0 in 1.005s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:52 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d Jun 23 04:26:52 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Flow 'volume_create_manager' (a02945de-eae8-46a0-92bb-f07addc24616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db64b9c4-77b7-476e-8071-0100386220a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db64b9c4-77b7-476e-8071-0100386220a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1122992534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661c3538-b601-40a5-9179-5ebee48d1aaf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5156db93e854443ae68d4d2913f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:53Z,use_quota=True,user_id='b6824eebe70f4403a476cbf940a7ae9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd3b730-7daf-4ace-ad1e-9d90f20dbb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fd3b730-7daf-4ace-ad1e-9d90f20dbb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31646a2e-89f8-43b4-8cf5-6af8ffd57ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31646a2e-89f8-43b4-8cf5-6af8ffd57ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '661c3538-b601-40a5-9179-5ebee48d1aaf', 'volume_name': 'volume-661c3538-b601-40a5-9179-5ebee48d1aaf', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1c6f7d-7e62-4009-b996-a0d475abfc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1c6f7d-7e62-4009-b996-a0d475abfc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944b5b55-e2f6-48f8-9a53-3fc5c4874adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:53 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Volume 661c3538-b601-40a5-9179-5ebee48d1aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-661c3538-b601-40a5-9179-5ebee48d1aaf', 'volume_size': 1} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:53 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d" returned: 0 in 0.827s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1122992534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=661c3538-b601-40a5-9179-5ebee48d1aaf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5156db93e854443ae68d4d2913f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:53Z,use_quota=True,user_id='b6824eebe70f4403a476cbf940a7ae9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Creating volume 661c3538-b601-40a5-9179-5ebee48d1aaf {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:53 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:53 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf 1073741824 Jun 23 04:26:53 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5064dec6-c8f2-4978-9e19-cca58b5b8918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21a7bbab-3458-498d-b9c1-5309c456e96d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4fe6bd-b66a-469f-bafc-1436303a1072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:53 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Volume volume-21a7bbab-3458-498d-b9c1-5309c456e96d (21a7bbab-3458-498d-b9c1-5309c456e96d): created successfully Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc4fe6bd-b66a-469f-bafc-1436303a1072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (e7d075a8-a1fd-43c3-afe0-194ca50328ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:53 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1907fddf-cd2e-4b16-9d33-d39d8d9a2263 tempest-VolumesActionsTest-775901096 None] Created volume successfully. Jun 23 04:26:54 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf 1073741824" returned: 0 in 0.909s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:54 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf Jun 23 04:26:54 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:54 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:54 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-21a7bbab-3458-498d-b9c1-5309c456e96d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-21a7bbab-3458-498d-b9c1-5309c456e96d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-quobyte-21a7bbab-3458-498d-b9c1-5309c456e96d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-21a7bbab-3458-498d-b9c1-5309c456e96d" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3ef7f0-5f6b-4b70-9dec-93638bc8f092]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:26:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:55 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d Jun 23 04:26:55 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:55 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf" returned: 0 in 0.841s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (944b5b55-e2f6-48f8-9a53-3fc5c4874adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-661c3538-b601-40a5-9179-5ebee48d1aaf', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff59bf7b-46cb-45f2-a8c2-4cbee0cc99e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:55 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Volume volume-661c3538-b601-40a5-9179-5ebee48d1aaf (661c3538-b601-40a5-9179-5ebee48d1aaf): created successfully Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff59bf7b-46cb-45f2-a8c2-4cbee0cc99e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Flow 'volume_create_manager' (a02945de-eae8-46a0-92bb-f07addc24616) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:55 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-060ad8f9-f64f-48b1-9bbb-2333b33b4524 tempest-VolumesTestJSON-1680835286 None] Created volume successfully. Jun 23 04:26:55 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.876s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 8 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:26:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:26:56 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d" returned: 0 in 1.198s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:56 devstack sudo[102760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d Jun 23 04:26:56 devstack sudo[102760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:57 devstack sudo[102760]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Flow 'volume_create_manager' (b5e074ee-de97-479d-88ed-e51b99dd1b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef29789-328c-4bcd-a160-4fe7f18e518e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-21a7bbab-3458-498d-b9c1-5309c456e96d" returned: 0 in 1.255s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef29789-328c-4bcd-a160-4fe7f18e518e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1255190885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be352d2-373a-44fc-81a0-15ac58ec1c72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5156db93e854443ae68d4d2913f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:57Z,use_quota=True,user_id='b6824eebe70f4403a476cbf940a7ae9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf8800b-8f4b-4fbd-8e1d-cee8bd0513b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caf8800b-8f4b-4fbd-8e1d-cee8bd0513b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1619aa6e-8df3-48da-a34d-4cdf8f3865b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1619aa6e-8df3-48da-a34d-4cdf8f3865b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7be352d2-373a-44fc-81a0-15ac58ec1c72', 'volume_name': 'volume-7be352d2-373a-44fc-81a0-15ac58ec1c72', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be9a7b0-5f03-4979-9e09-9c876e0387cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be9a7b0-5f03-4979-9e09-9c876e0387cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c5c804-7c2b-4195-9f6e-2a49b9f43aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:26:57 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Volume 7be352d2-373a-44fc-81a0-15ac58ec1c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7be352d2-373a-44fc-81a0-15ac58ec1c72', 'volume_size': 1} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1255190885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7be352d2-373a-44fc-81a0-15ac58ec1c72,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5156db93e854443ae68d4d2913f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:26:57Z,use_quota=True,user_id='b6824eebe70f4403a476cbf940a7ae9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Creating volume 7be352d2-373a-44fc-81a0-15ac58ec1c72 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:26:57 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-21a7bbab-3458-498d-b9c1-5309c456e96d" released by "delete_volume" :: held 2.670s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:57 devstack sudo[102811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 1073741824 Jun 23 04:26:57 devstack sudo[102811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Created reservations ['744188e3-866c-4354-ac2d-5b77bc1642cf', '5cf303db-525b-482d-a3b7-c841afd0c888', 'fc592f70-af5b-47ad-8ffb-20eb87f7abfd', '53b17ebe-731c-4e8f-9f1e-47f175a81524'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:26:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:26:58 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:26:58 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:26:59 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Jun 23 04:26:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.377s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:26:59 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:26:59 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Deleted volume successfully. Jun 23 04:26:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3b3a2bb4-579e-470f-b4e6-c7c262b6ba09 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-21a7bbab-3458-498d-b9c1-5309c456e96d-delete_volume" released by "delete_volume" :: held 4.772s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:26:59 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:26:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (1e1bc022-e47a-4452-b63e-903a060ab9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:26:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b01ced-32bd-4e68-b135-2121c3741272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35b01ced-32bd-4e68-b135-2121c3741272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2132024721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a469463-32e0-46e6-9580-39a17f5d3705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:00Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117752aa-cbe6-442f-a199-f21bfef5ef3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (117752aa-cbe6-442f-a199-f21bfef5ef3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d90d37e-50f4-4ff3-b475-9672c5e48166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d90d37e-50f4-4ff3-b475-9672c5e48166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a469463-32e0-46e6-9580-39a17f5d3705', 'volume_name': 'volume-9a469463-32e0-46e6-9580-39a17f5d3705', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cda2bee-9a30-4db7-b92b-781768122e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cda2bee-9a30-4db7-b92b-781768122e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e5955a-34b2-4039-9dd4-5468c0887e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Volume 9a469463-32e0-46e6-9580-39a17f5d3705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a469463-32e0-46e6-9580-39a17f5d3705', 'volume_size': 1} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:00 devstack sudo[102811]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 1073741824" returned: 0 in 2.709s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:00 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 Jun 23 04:27:00 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:01 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72" returned: 0 in 1.276s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] <== create_volume: return (4071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.076s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2132024721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a469463-32e0-46e6-9580-39a17f5d3705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:00Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Creating volume 9a469463-32e0-46e6-9580-39a17f5d3705 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:27:01 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:INSERT=23,cinder:UPDATE=115,cinder:SELECT=62,cinder:DELETE=7 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c5c804-7c2b-4195-9f6e-2a49b9f43aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7be352d2-373a-44fc-81a0-15ac58ec1c72', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a2261f-8316-4762-bd41-7250b85549d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:01 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 1073741824 Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=83,cinder:UPDATE=90,cinder:DELETE=10,cinder:INSERT=24 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:27:01 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:01 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Volume volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 (7be352d2-373a-44fc-81a0-15ac58ec1c72): created successfully Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12a2261f-8316-4762-bd41-7250b85549d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Flow 'volume_create_manager' (b5e074ee-de97-479d-88ed-e51b99dd1b98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-880d87ca-f68a-4461-9e61-11f8f9fb5f1a tempest-VolumesTestJSON-1680835286 None] Created volume successfully. Jun 23 04:27:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6a10c244-4dee-4c07-a4f1-0c3347dbf4da tempest-VolumesActionsTest-1613227002 None] Acquiring lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e" by "attach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6a10c244-4dee-4c07-a4f1-0c3347dbf4da tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e" acquired by "attach_volume" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6a10c244-4dee-4c07-a4f1-0c3347dbf4da tempest-VolumesActionsTest-1613227002 None] Attaching volume b09834b4-9a56-4ed1-81ea-976c59f8a98e to instance 8bcb6220-6f39-4d56-9649-76316a068841 at mountpoint /dev/vdb on host None. Jun 23 04:27:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6a10c244-4dee-4c07-a4f1-0c3347dbf4da tempest-VolumesActionsTest-1613227002 None] Attach volume completed successfully. Jun 23 04:27:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6a10c244-4dee-4c07-a4f1-0c3347dbf4da tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e" released by "attach_volume" :: held 0.123s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:02 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 1073741824" returned: 0 in 1.305s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:03 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 Jun 23 04:27:03 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c132056-0b8c-4c01-98c5-3bd766466b4c tempest-VolumesActionsTest-1613227002 None] Acquiring lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-detach_volume" by "detach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c132056-0b8c-4c01-98c5-3bd766466b4c tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:03 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2c132056-0b8c-4c01-98c5-3bd766466b4c tempest-VolumesActionsTest-1613227002 None] Detaching volume b09834b4-9a56-4ed1-81ea-976c59f8a98e from instance 8bcb6220-6f39-4d56-9649-76316a068841. Jun 23 04:27:03 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2c132056-0b8c-4c01-98c5-3bd766466b4c tempest-VolumesActionsTest-1613227002 None] Detach volume completed successfully. Jun 23 04:27:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c132056-0b8c-4c01-98c5-3bd766466b4c tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-detach_volume" released by "detach_volume" :: held 0.189s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:04 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705" returned: 0 in 1.174s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] <== create_volume: return (2562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.566s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58e5955a-34b2-4039-9dd4-5468c0887e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a469463-32e0-46e6-9580-39a17f5d3705', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bffeb02-6aed-4d93-a2d1-2b643aedbfa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:04 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Volume volume-9a469463-32e0-46e6-9580-39a17f5d3705 (9a469463-32e0-46e6-9580-39a17f5d3705): created successfully Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bffeb02-6aed-4d93-a2d1-2b643aedbfa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (1e1bc022-e47a-4452-b63e-903a060ab9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Flow 'volume_create_manager' (d8e39034-8c7f-4ae9-9f8f-71ffe1271ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6802540-338a-4760-910f-7d5bc2098196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5ffc3c0e-95dd-419d-ba33-6fefbbeeb9d8 tempest-VolumesActionsTest-775901096 None] Created volume successfully. Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6802540-338a-4760-910f-7d5bc2098196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1464821895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac908507-22f0-42a4-8579-820c2252396b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5156db93e854443ae68d4d2913f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:04Z,use_quota=True,user_id='b6824eebe70f4403a476cbf940a7ae9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026e79ab-63f8-493b-97ef-eab7f45e2309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (026e79ab-63f8-493b-97ef-eab7f45e2309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407cde6c-e44c-4e34-a580-8ddf272c414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (407cde6c-e44c-4e34-a580-8ddf272c414b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac908507-22f0-42a4-8579-820c2252396b', 'volume_name': 'volume-ac908507-22f0-42a4-8579-820c2252396b', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3947da7-8d9f-4ec6-9411-50a91119e066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3947da7-8d9f-4ec6-9411-50a91119e066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac0b7f5-7175-46e7-a3fe-192a05a806c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:04 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Volume ac908507-22f0-42a4-8579-820c2252396b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac908507-22f0-42a4-8579-820c2252396b', 'volume_size': 1} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1464821895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac908507-22f0-42a4-8579-820c2252396b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b5156db93e854443ae68d4d2913f42fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:04Z,use_quota=True,user_id='b6824eebe70f4403a476cbf940a7ae9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Creating volume ac908507-22f0-42a4-8579-820c2252396b {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:27:04 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:04 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b 1073741824 Jun 23 04:27:04 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-9a469463-32e0-46e6-9580-39a17f5d3705-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-9a469463-32e0-46e6-9580-39a17f5d3705-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-quobyte-9a469463-32e0-46e6-9580-39a17f5d3705" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-9a469463-32e0-46e6-9580-39a17f5d3705" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[08039bcb-fbfa-4847-b154-8d0d9231e07a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:05 devstack sudo[102874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 Jun 23 04:27:05 devstack sudo[102874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:06 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b 1073741824" returned: 0 in 1.513s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:06 devstack sudo[102920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b Jun 23 04:27:06 devstack sudo[102920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:06 devstack sudo[102874]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705" returned: 0 in 1.391s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:06 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705 Jun 23 04:27:06 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:06 devstack sudo[102920]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b" returned: 0 in 0.840s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] <== create_volume: return (2463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.469s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bac0b7f5-7175-46e7-a3fe-192a05a806c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac908507-22f0-42a4-8579-820c2252396b', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b8362-0d6e-4e0f-b8dd-d175f3e783b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Volume volume-ac908507-22f0-42a4-8579-820c2252396b (ac908507-22f0-42a4-8579-820c2252396b): created successfully Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80b8362-0d6e-4e0f-b8dd-d175f3e783b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Flow 'volume_create_manager' (d8e39034-8c7f-4ae9-9f8f-71ffe1271ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a92e4b4d-a49a-4fc6-a170-cc77d147f88f tempest-VolumesTestJSON-1680835286 None] Created volume successfully. Jun 23 04:27:07 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9a469463-32e0-46e6-9580-39a17f5d3705" returned: 0 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-9a469463-32e0-46e6-9580-39a17f5d3705" released by "delete_volume" :: held 2.213s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Created reservations ['4291736c-3e86-4ea6-a98a-c531ba427ec5', '23b098a1-a983-4687-be8c-4a1252d19045', 'f90982bb-cd05-4056-8390-89085137f016', '1e41bb22-9484-4e44-b9c2-c89f8a026589'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:07 devstack sudo[102931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:07 devstack sudo[102931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:08 devstack sudo[102931]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Deleted volume successfully. Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4a112f42-e73e-4262-9d67-5da86db9b718 tempest-VolumesActionsTest-1659149944 None] Lock "cinder-9a469463-32e0-46e6-9580-39a17f5d3705-delete_volume" released by "delete_volume" :: held 3.303s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Acquiring lock "cinder-ac908507-22f0-42a4-8579-820c2252396b-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Lock "cinder-ac908507-22f0-42a4-8579-820c2252396b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Acquiring lock "cinder-quobyte-ac908507-22f0-42a4-8579-820c2252396b" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Lock "cinder-quobyte-ac908507-22f0-42a4-8579-820c2252396b" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc839b-9c60-4e1f-b3c1-8ed58a1674f0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:08 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b Jun 23 04:27:08 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:08 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (8a618905-a771-4071-9450-9664580a859f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d550e5-c685-4408-bf1f-9fa88b0db0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9d550e5-c685-4408-bf1f-9fa88b0db0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433219693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910c24c7-e96e-45a4-820a-faf950cd9542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:09Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d105fd5e-a9c9-4694-bf34-bd639489fe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d105fd5e-a9c9-4694-bf34-bd639489fe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cf06db-49f3-4768-9e02-ae06c91c9e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21cf06db-49f3-4768-9e02-ae06c91c9e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '910c24c7-e96e-45a4-820a-faf950cd9542', 'volume_name': 'volume-910c24c7-e96e-45a4-820a-faf950cd9542', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b6ad42-ee83-4cd6-9654-baa900f73728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b6ad42-ee83-4cd6-9654-baa900f73728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c220a359-e480-4e49-9a25-c77dfec8650b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:09 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Volume 910c24c7-e96e-45a4-820a-faf950cd9542: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-910c24c7-e96e-45a4-820a-faf950cd9542', 'volume_size': 1} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-433219693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=910c24c7-e96e-45a4-820a-faf950cd9542,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:09Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Creating volume 910c24c7-e96e-45a4-820a-faf950cd9542 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:27:09 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:09 devstack sudo[102938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 1073741824 Jun 23 04:27:09 devstack sudo[102938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:09 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b" returned: 0 in 0.891s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:09 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b Jun 23 04:27:09 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:10 devstack sudo[102938]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 1073741824" returned: 0 in 0.990s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:10 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 Jun 23 04:27:10 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:10 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ac908507-22f0-42a4-8579-820c2252396b" returned: 0 in 0.685s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Lock "cinder-quobyte-ac908507-22f0-42a4-8579-820c2252396b" released by "delete_volume" :: held 1.663s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Created reservations ['26978eb0-eeea-4b30-816f-f173147aa594', 'b7ec7ca6-de13-4e74-b5e5-dda835973587', '95399782-e0c0-4604-8c77-7d9c292a4fef', '9a456200-6fb0-4338-9160-f08c6c0cd407'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:10 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:10 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Acquiring lock "cinder-7be352d2-373a-44fc-81a0-15ac58ec1c72-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Lock "cinder-7be352d2-373a-44fc-81a0-15ac58ec1c72-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:10 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542" returned: 0 in 0.813s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:27:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c220a359-e480-4e49-9a25-c77dfec8650b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-910c24c7-e96e-45a4-820a-faf950cd9542', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c768e6-4bd1-4dd9-b871-a330e9a9a488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Acquiring lock "cinder-quobyte-7be352d2-373a-44fc-81a0-15ac58ec1c72" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:11 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Volume volume-910c24c7-e96e-45a4-820a-faf950cd9542 (910c24c7-e96e-45a4-820a-faf950cd9542): created successfully Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c768e6-4bd1-4dd9-b871-a330e9a9a488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (8a618905-a771-4071-9450-9664580a859f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d8a1eb15-d074-4251-a3f5-8e472da01623 tempest-VolumesActionsTest-775901096 None] Created volume successfully. Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Lock "cinder-quobyte-7be352d2-373a-44fc-81a0-15ac58ec1c72" acquired by "delete_volume" :: waited 0.050s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2dabd-45fc-4757-9cb5-d769ae4a523e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:11 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.789s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Deleted volume successfully. Jun 23 04:27:11 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 Jun 23 04:27:11 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9d605774-ca7b-40a0-a791-4effd91f83cb tempest-VolumesTestJSON-1680835286 None] Lock "cinder-ac908507-22f0-42a4-8579-820c2252396b-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:12 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72" returned: 0 in 0.887s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:12 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72 Jun 23 04:27:12 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-910c24c7-e96e-45a4-820a-faf950cd9542-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Lock "cinder-910c24c7-e96e-45a4-820a-faf950cd9542-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Acquiring lock "cinder-quobyte-910c24c7-e96e-45a4-820a-faf950cd9542" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-910c24c7-e96e-45a4-820a-faf950cd9542" acquired by "delete_volume" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace44c27-9d2a-4169-9f2b-3cff25cc8f79]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:12 devstack sudo[102983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 Jun 23 04:27:12 devstack sudo[102983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:12 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7be352d2-373a-44fc-81a0-15ac58ec1c72" returned: 0 in 0.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Lock "cinder-quobyte-7be352d2-373a-44fc-81a0-15ac58ec1c72" released by "delete_volume" :: held 1.638s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Created reservations ['0bd5f6d2-04c9-438a-beb1-63e85462b71c', 'da527c78-e914-48a0-b0fa-502d8a3449f1', 'ccd664bd-7fa5-407f-bcab-cbb801d3f467', '25a9894d-b944-4f30-8e1b-2263c1585411'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:12 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:12 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:13 devstack sudo[102983]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542" returned: 0 in 0.807s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Acquiring lock "cinder-661c3538-b601-40a5-9179-5ebee48d1aaf-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:13 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542 Jun 23 04:27:13 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Lock "cinder-661c3538-b601-40a5-9179-5ebee48d1aaf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Acquiring lock "cinder-quobyte-661c3538-b601-40a5-9179-5ebee48d1aaf" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Lock "cinder-quobyte-661c3538-b601-40a5-9179-5ebee48d1aaf" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[569a7158-da44-4407-9df5-2d8403b04bee]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:13 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf Jun 23 04:27:13 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:13 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.688s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Deleted volume successfully. Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f259772a-5669-4b0c-86b7-92c7cf0b734b tempest-VolumesTestJSON-1680835286 None] Lock "cinder-7be352d2-373a-44fc-81a0-15ac58ec1c72-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:13 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-910c24c7-e96e-45a4-820a-faf950cd9542" returned: 0 in 0.730s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Lock "cinder-quobyte-910c24c7-e96e-45a4-820a-faf950cd9542" released by "delete_volume" :: held 1.584s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Created reservations ['9b768e67-bae8-45d0-97f1-948c65d9ae45', '3b6d16cb-9d4a-42a5-81c5-4271fcb4bfca', 'b9390a0c-f99a-4b81-9ce0-754aac08d3cc', '2e8332e9-99cd-41b5-910d-0d05956fea70'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:14 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:14 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:14 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf" returned: 0 in 0.783s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:14 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf Jun 23 04:27:14 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:14 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.674s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Deleted volume successfully. Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5290d8df-f213-475b-a06d-4814701ae55a tempest-VolumesActionsTest-1659149944 None] Lock "cinder-910c24c7-e96e-45a4-820a-faf950cd9542-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:14 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-661c3538-b601-40a5-9179-5ebee48d1aaf" returned: 0 in 0.661s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Lock "cinder-quobyte-661c3538-b601-40a5-9179-5ebee48d1aaf" released by "delete_volume" :: held 1.489s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:14 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Created reservations ['22896fb3-b5c3-4b06-a2c1-155cee267c50', 'eb8fd214-65d6-490a-b907-54461532f750', 'd59ee7fd-018a-4992-ab41-5b12b75d627a', '8efa94bc-a14b-4965-aa28-dd8abb189d32'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:15 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:15 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (dbb70a97-a89e-416a-9a58-eb34c863a032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ddc67b-8d25-43af-bbd9-a90f105284cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30ddc67b-8d25-43af-bbd9-a90f105284cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046361842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca91862-bba5-4551-91e5-7a313f6853a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:15Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850cfd62-9810-4074-aa5d-e772023defcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (850cfd62-9810-4074-aa5d-e772023defcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e5aabe-c92c-44b1-bdeb-c545de243ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e5aabe-c92c-44b1-bdeb-c545de243ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ca91862-bba5-4551-91e5-7a313f6853a7', 'volume_name': 'volume-2ca91862-bba5-4551-91e5-7a313f6853a7', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9006ebeb-6ccb-44df-8aeb-0382b80d9e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9006ebeb-6ccb-44df-8aeb-0382b80d9e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668e825c-9a17-487d-bec4-72e2ddcc997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Volume 2ca91862-bba5-4551-91e5-7a313f6853a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ca91862-bba5-4551-91e5-7a313f6853a7', 'volume_size': 1} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2046361842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ca91862-bba5-4551-91e5-7a313f6853a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='013ff44a6bed42d3ac88533a84163b05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:15Z,use_quota=True,user_id='07af42b66b8d4435b437ede1c4b23e48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Creating volume 2ca91862-bba5-4551-91e5-7a313f6853a7 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:27:15 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:15 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 1073741824 Jun 23 04:27:15 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:15 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.689s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Deleted volume successfully. Jun 23 04:27:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f3b9456b-fbc8-4dad-9674-11e5d770d81e tempest-VolumesTestJSON-1680835286 None] Lock "cinder-661c3538-b601-40a5-9179-5ebee48d1aaf-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:16 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 1073741824" returned: 0 in 0.935s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:16 devstack sudo[103017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 Jun 23 04:27:16 devstack sudo[103017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:16 devstack sudo[103017]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7" returned: 0 in 0.718s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668e825c-9a17-487d-bec4-72e2ddcc997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ca91862-bba5-4551-91e5-7a313f6853a7', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ea2dc-b8bc-4fde-9f76-e32ae9a0a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Volume volume-2ca91862-bba5-4551-91e5-7a313f6853a7 (2ca91862-bba5-4551-91e5-7a313f6853a7): created successfully Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d75ea2dc-b8bc-4fde-9f76-e32ae9a0a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Flow 'volume_create_manager' (dbb70a97-a89e-416a-9a58-eb34c863a032) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1ba92ab1-b879-4b4d-aae7-341df0eb89c5 tempest-VolumesActionsTest-775901096 None] Created volume successfully. Jun 23 04:27:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Acquiring lock "cinder-2ca91862-bba5-4551-91e5-7a313f6853a7-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Lock "cinder-2ca91862-bba5-4551-91e5-7a313f6853a7-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Acquiring lock "cinder-quobyte-2ca91862-bba5-4551-91e5-7a313f6853a7" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Lock "cinder-quobyte-2ca91862-bba5-4551-91e5-7a313f6853a7" acquired by "delete_volume" :: waited 0.041s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5511815-2ff6-4412-8e9a-cc46d5a40513]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:18 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 Jun 23 04:27:18 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:19 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7" returned: 0 in 1.341s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:20 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7 Jun 23 04:27:20 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:20 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2ca91862-bba5-4551-91e5-7a313f6853a7" returned: 0 in 0.664s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Lock "cinder-quobyte-2ca91862-bba5-4551-91e5-7a313f6853a7" released by "delete_volume" :: held 2.074s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Created reservations ['35c52d0f-4956-4acb-bebb-ed631581846b', 'c1bb2a09-44f0-4ba3-8b19-b0c5c0394b90', '449c287e-15d2-476c-aa33-ad1a9daca31a', 'd3fb895d-c0ee-49f8-bda2-ac0573ee7f85'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:20 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:20 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9b63eb52-ed5f-453a-9886-7430ff5005bb tempest-BackendsCapabilitiesAdminTestsJSON-304697970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93326) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 04:27:21 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.684s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:21 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:21 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Deleted volume successfully. Jun 23 04:27:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e5ee13d-37ac-4f6d-ab02-7603e9c13d6e tempest-VolumesActionsTest-775901096 None] Lock "cinder-2ca91862-bba5-4551-91e5-7a313f6853a7-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5c5207c5-c407-42f0-9959-df7f144ed9f4 tempest-BackendsCapabilitiesAdminTestsJSON-304697970 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578239440918, 'free_capacity_gb': 1775.7578239440918, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93326) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Flow 'volume_create_manager' (7ac847b0-b064-485a-a9cc-8489b8c9485d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b4df83-580c-4a13-8817-003bcccb7627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b4df83-580c-4a13-8817-003bcccb7627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1629762446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9e8db1-80ff-4873-ba52-05376e6ce029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d6822d29ff4d35a12748af0d236dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:22Z,use_quota=True,user_id='321f20edf3f54446a5395735e5c6b028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d53bffe-d663-4a65-8be0-a386e7bbe134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d53bffe-d663-4a65-8be0-a386e7bbe134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26b3297-98be-4392-8012-d9254e9e0b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b26b3297-98be-4392-8012-d9254e9e0b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b9e8db1-80ff-4873-ba52-05376e6ce029', 'volume_name': 'volume-7b9e8db1-80ff-4873-ba52-05376e6ce029', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0048581c-e4ba-446a-bf14-326b26fff2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0048581c-e4ba-446a-bf14-326b26fff2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8a00c9-8fe2-4685-bfd7-34962ff5eeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:22 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Volume 7b9e8db1-80ff-4873-ba52-05376e6ce029: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b9e8db1-80ff-4873-ba52-05376e6ce029', 'volume_size': 1} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1629762446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b9e8db1-80ff-4873-ba52-05376e6ce029,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0d6822d29ff4d35a12748af0d236dca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:22Z,use_quota=True,user_id='321f20edf3f54446a5395735e5c6b028',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Creating volume 7b9e8db1-80ff-4873-ba52-05376e6ce029 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:27:22 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:27:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:22 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 1073741824 Jun 23 04:27:22 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:23 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 1073741824" returned: 0 in 1.028s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:23 devstack sudo[103069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 Jun 23 04:27:23 devstack sudo[103069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:24 devstack sudo[103069]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029" returned: 0 in 0.834s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] <== create_volume: return (1924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a8a00c9-8fe2-4685-bfd7-34962ff5eeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b9e8db1-80ff-4873-ba52-05376e6ce029', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9c991b-edde-457b-9568-a9c895aabbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:24 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Volume volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 (7b9e8db1-80ff-4873-ba52-05376e6ce029): created successfully Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9c991b-edde-457b-9568-a9c895aabbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Flow 'volume_create_manager' (7ac847b0-b064-485a-a9cc-8489b8c9485d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9446db8c-a79a-4eb5-b1b9-f9aed8811889 tempest-AttachVolumeShelveTestJSON-1042863999 None] Created volume successfully. Jun 23 04:27:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-548f155f-aa8e-45c5-9772-0ab54b7b5656 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e" by "attach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-548f155f-aa8e-45c5-9772-0ab54b7b5656 tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e" acquired by "attach_volume" :: waited 0.055s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-548f155f-aa8e-45c5-9772-0ab54b7b5656 tempest-VolumesActionsTest-1613227002 None] Attaching volume b09834b4-9a56-4ed1-81ea-976c59f8a98e to instance f9a973a0-230c-425a-9ecc-860b531c20e8 at mountpoint /dev/vdb on host None. Jun 23 04:27:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-548f155f-aa8e-45c5-9772-0ab54b7b5656 tempest-VolumesActionsTest-1613227002 None] Attach volume completed successfully. Jun 23 04:27:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-548f155f-aa8e-45c5-9772-0ab54b7b5656 tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e" released by "attach_volume" :: held 0.176s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4d29a46a-770e-4160-b977-36a2b18384ca tempest-VolumesActionsTest-1613227002 None] Acquiring lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-detach_volume" by "detach_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:27:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4d29a46a-770e-4160-b977-36a2b18384ca tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:27:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4d29a46a-770e-4160-b977-36a2b18384ca tempest-VolumesActionsTest-1613227002 None] Detaching volume b09834b4-9a56-4ed1-81ea-976c59f8a98e from instance f9a973a0-230c-425a-9ecc-860b531c20e8. Jun 23 04:27:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4d29a46a-770e-4160-b977-36a2b18384ca tempest-VolumesActionsTest-1613227002 None] Detach volume completed successfully. Jun 23 04:27:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4d29a46a-770e-4160-b977-36a2b18384ca tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-detach_volume" released by "detach_volume" :: held 0.078s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:27:41 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=68,cinder:DELETE=8,cinder:SELECT=51,cinder:INSERT=18 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:27:41 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:INSERT=15,cinder:SELECT=53,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Flow 'volume_create_manager' (fd81dcc3-4d09-47cf-a78c-1306f23698a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7387bc8-0f5c-4c38-9a80-9be38e8f5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7387bc8-0f5c-4c38-9a80-9be38e8f5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-684292808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bda1bde-0cd6-475c-a721-ad48eb34ee30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f38ad47d5d489c9a659ab33cbf1db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:42Z,use_quota=True,user_id='a6d982c79b2a4448addced2a324729d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f61cdc-3cfd-4723-90a6-e7c514956a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6f61cdc-3cfd-4723-90a6-e7c514956a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0c282e-5f53-4b17-bdc1-dfc84b4583c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:42 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a0c282e-5f53-4b17-bdc1-dfc84b4583c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4bda1bde-0cd6-475c-a721-ad48eb34ee30', 'volume_name': 'volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d4e0d1-8d44-431c-b5b5-45c6926d31a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d4e0d1-8d44-431c-b5b5-45c6926d31a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e750a8-3c98-4de9-8b58-b35b75496ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:43 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Volume 4bda1bde-0cd6-475c-a721-ad48eb34ee30: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Trying to clone 4bda1bde-0cd6-475c-a721-ad48eb34ee30 from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-d6457062-2f72-48b8-98a2-66c58ef1309a req-bd75a471-096a-46e4-8ade-7f164dbe4ae2 tempest-AttachVolumeShelveTestJSON-1042863999 None] No connector for attachment ced0d937-03b9-4fc1-8f2b-f95f6b1e67e8; skipping storage backend terminate_connection call. {{(pid=93326) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-d6457062-2f72-48b8-98a2-66c58ef1309a req-bd75a471-096a-46e4-8ade-7f164dbe4ae2 tempest-AttachVolumeShelveTestJSON-1042863999 None] Deleting attachment ced0d937-03b9-4fc1-8f2b-f95f6b1e67e8. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:27:43 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Image download 20.69 MB at 20.69 MB/s Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[de338d86-d2f9-440e-99b0-a08770ec288d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9448395-6e1b-4f09-a897-a4dff111bb51]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:43 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:27:43 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:44 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD Jun 23 04:27:44 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:44 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 is fetched for user a6d982c79b2a4448addced2a324729d8. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:27:44 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 1.039s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae8eda-e2d7-4f70-9566-53757b3737de]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa215819-a6dc-490e-beb4-2bda54cc634f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:45 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD Jun 23 04:27:45 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:45 devstack sudo[103324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:27:45 devstack sudo[103324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:45 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD" returned: 0 in 0.858s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:45 devstack sudo[103324]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.932s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.f25fc4bc-a04a-4745-86e9-6b8acd98024emnduwh7s.img {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:45 devstack sudo[103336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.f25fc4bc-a04a-4745-86e9-6b8acd98024emnduwh7s.img Jun 23 04:27:45 devstack sudo[103336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:51 devstack sudo[103336]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.f25fc4bc-a04a-4745-86e9-6b8acd98024emnduwh7s.img" returned: 0 in 5.553s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d35d42b-55bb-4249-a698-f4954ee29a0c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:27:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:51 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:27:51 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:52 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.941s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:52 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e, size 1024.00 MB, duration 5.55 sec, destination /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.f25fc4bc-a04a-4745-86e9-6b8acd98024emnduwh7s.img {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:27:52 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Converted 1024.00 MB image at 184.38 MB/s Jun 23 04:27:52 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] f25fc4bc-a04a-4745-86e9-6b8acd98024e was raw, no need to convert to raw {{(pid=93326) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:27:54 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:27:54 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:27:54 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Flow 'volume_create_manager' (f57ec37b-7d5c-4773-b46e-974fe2efbef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9cf046-def3-4928-ab93-a8e1a9284cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9cf046-def3-4928-ab93-a8e1a9284cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1018434206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab97678805a4dca983170e8b0b50743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:55Z,use_quota=True,user_id='72b15b5f036c4398b4ce139ee8c424de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83229d02-063f-4ad6-ac96-14347519472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83229d02-063f-4ad6-ac96-14347519472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353eeb2e-83ad-4a29-b960-f747fbb4751f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (353eeb2e-83ad-4a29-b960-f747fbb4751f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f', 'volume_name': 'volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8d49bb-02c2-4cd9-ab61-f99383b0b494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8d49bb-02c2-4cd9-ab61-f99383b0b494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1c9ad0-593c-45ed-8093-776b8f470d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:27:55 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Volume c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f', 'volume_size': 1} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:27:55 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.026s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:27:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:28:04 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:28:05 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.201s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Uploaded volume to glance image-id: f25fc4bc-a04a-4745-86e9-6b8acd98024e. {{(pid=93326) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.278s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-684292808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bda1bde-0cd6-475c-a721-ad48eb34ee30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22f38ad47d5d489c9a659ab33cbf1db2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:42Z,use_quota=True,user_id='a6d982c79b2a4448addced2a324729d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Creating volume 4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:14 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:14 devstack sudo[103518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 1073741824 Jun 23 04:28:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7b963d0c-51db-479f-9952-9d5575671d33 tempest-VolumesActionsTest-1613227002 None] Copy volume to image completed successfully. Jun 23 04:28:14 devstack sudo[103518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:14 devstack sudo[103518]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 1073741824" returned: 0 in 0.908s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:15 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:15 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:15 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 0 in 0.653s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.572s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:27:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1018434206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab97678805a4dca983170e8b0b50743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:27:55Z,use_quota=True,user_id='72b15b5f036c4398b4ce139ee8c424de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Creating volume c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:15 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:15 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f 1073741824 Jun 23 04:28:15 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Attempting download of 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume 4bda1bde-0cd6-475c-a721-ad48eb34ee30. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba239ef9-a69d-4844-9489-c886145e56a2]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:15 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g Jun 23 04:28:15 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:16 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f 1073741824" returned: 0 in 0.875s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:16 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g" returned: 0 in 0.814s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:16 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f Jun 23 04:28:16 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:16 devstack sudo[103538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g Jun 23 04:28:16 devstack sudo[103538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:17 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" returned: 0 in 0.678s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.893s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe1c9ad0-593c-45ed-8093-776b8f470d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483c85f5-2756-4e2f-990c-a7f941d4c361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f52e34c7-b165-4f24-bfc1-6ee322a0bc75]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Volume volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f (c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f): created successfully Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (483c85f5-2756-4e2f-990c-a7f941d4c361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:17 devstack sudo[103538]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Flow 'volume_create_manager' (f57ec37b-7d5c-4773-b46e-974fe2efbef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g" returned: 1 in 0.794s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_jmejzn7g' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fda9c9-2d43-42c9-a202-8b7963a36566]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4dc22e4c-dece-48b7-b8db-898e814e6052 tempest-SnapshotMetadataTestJSON-310490636 None] Created volume successfully. Jun 23 04:28:17 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:28:17 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:17 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD Jun 23 04:28:17 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:18 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.837s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb59b2c-ac8e-4776-a520-204c8cc00abd]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:18 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:18 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] 930bd165-a705-4fa7-8ad1-0668e12d9b30 was qcow2, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:28:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:18 devstack sudo[103556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:18 devstack sudo[103556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:18 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:28:18 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:19 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.895s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:19 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img Jun 23 04:28:19 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:21 devstack sudo[103556]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 0 in 3.173s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:21 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_bkn2bnbidevstack@QuobyteHD, size 112.00 MB, duration 3.17 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:28:21 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Converted 112.00 MB image at 35.29 MB/s Jun 23 04:28:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:21 devstack sudo[103588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 1G Jun 23 04:28:21 devstack sudo[103588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:23 devstack sudo[103588]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 1G" returned: 0 in 1.761s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:23 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[29eaec64-f15d-490a-b2bd-2ad5942e241d]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:23 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:23 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:24 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img" returned: 0 in 5.283s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:24 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4388a0e8-7eae-40fa-af14-2e6726faabf8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:24 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:28:24 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:24 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 0 in 1.337s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:24 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:24 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:25 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.921s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e, size 1024.00 MB, duration 5.28 sec, destination /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:28:25 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Converted 1024.00 MB image at 193.76 MB/s Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] 20d37246-f631-4a99-accb-480420fec5ff was raw, converting to qcow2 {{(pid=93326) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 23 04:28:25 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 1 in 0.763s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Downloaded image 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume 4bda1bde-0cd6-475c-a721-ad48eb34ee30 successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 for user a6d982c79b2a4448addced2a324729d8 is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Marking volume 4bda1bde-0cd6-475c-a721-ad48eb34ee30 as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d08d893-5ec7-4391-9253-2ff0c02f5500]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Copying metadata from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 to 4bda1bde-0cd6-475c-a721-ad48eb34ee30. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Creating volume glance metadata for volume 4bda1bde-0cd6-475c-a721-ad48eb34ee30 backed by image 930bd165-a705-4fa7-8ad1-0668e12d9b30 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e750a8-3c98-4de9-8b58-b35b75496ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1aba81-2ede-48b8-9e89-af3fb903a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:25 devstack sudo[103612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img Jun 23 04:28:25 devstack sudo[103612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:25 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Volume volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 (4bda1bde-0cd6-475c-a721-ad48eb34ee30): created successfully Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea1aba81-2ede-48b8-9e89-af3fb903a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Flow 'volume_create_manager' (fd81dcc3-4d09-47cf-a78c-1306f23698a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:25 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d3fd0f9b-678f-4ed5-aff5-9e64104db849 tempest-VolumesImageMetadata-1154962914 None] Created volume successfully. Jun 23 04:28:26 devstack sudo[103612]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:26 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img Jun 23 04:28:26 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Acquiring lock "cinder-4bda1bde-0cd6-475c-a721-ad48eb34ee30-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Lock "cinder-4bda1bde-0cd6-475c-a721-ad48eb34ee30-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Acquiring lock "cinder-quobyte-4bda1bde-0cd6-475c-a721-ad48eb34ee30" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Lock "cinder-quobyte-4bda1bde-0cd6-475c-a721-ad48eb34ee30" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf6e569-fd47-4138-8422-03113e2a1deb]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:26 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:26 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:26 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img" returned: 1 in 0.768s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:28:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:26 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai Jun 23 04:28:26 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:27 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 0 in 0.792s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:27 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:27 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:27 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai" returned: 0 in 0.713s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:27 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Image conversion details: src /opt/stack/data/cinder/conversion/b09834b4-9a56-4ed1-81ea-976c59f8a98e.temp_image.20d37246-f631-4a99-accb-480420fec5ff6lxrxmoy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:28:27 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 23 04:28:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[67867ab6-abd0-4fef-b806-058561bb6649]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:27 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai Jun 23 04:28:27 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:28 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 1 in 0.856s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:28:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:28 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30 Jun 23 04:28:28 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:28 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_n0kp4wai" returned: 0 in 0.734s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:29 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4bda1bde-0cd6-475c-a721-ad48eb34ee30" returned: 0 in 0.858s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Lock "cinder-quobyte-4bda1bde-0cd6-475c-a721-ad48eb34ee30" released by "delete_volume" :: held 2.610s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Created reservations ['00013743-cb16-409a-9525-76eba4be94f6', '8291fc6c-423b-4043-8de4-f30632145bd0', '141c9b15-52e5-4b27-ab28-7a2cc69d3c61', '2045bc3f-3487-44a5-a5bf-adff719e4292'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:29 devstack sudo[103693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:29 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.725s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Uploaded volume to glance image-id: 20d37246-f631-4a99-accb-480420fec5ff. {{(pid=93326) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.642s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Creating offline snapshot e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 of volume c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:28:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-885a45f7-a2cb-43c4-9d26-0b726009802c tempest-VolumesActionsTest-1613227002 None] Copy volume to image completed successfully. Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3affe746-33fc-4dcc-ad7b-9474a5bd18d4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:30 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.772s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Deleted volume successfully. Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4c711429-2b84-43e1-94da-ceca260d234f tempest-VolumesImageMetadata-1154962914 None] Lock "cinder-4bda1bde-0cd6-475c-a721-ad48eb34ee30-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:30 devstack sudo[103697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f Jun 23 04:28:30 devstack sudo[103697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" returned: 0 in 0.928s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:30 devstack sudo[103697]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:31 devstack sudo[103703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 1G Jun 23 04:28:31 devstack sudo[103703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "cinder-quobyte-b09834b4-9a56-4ed1-81ea-976c59f8a98e" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Lock "cinder-quobyte-b09834b4-9a56-4ed1-81ea-976c59f8a98e" acquired by "delete_volume" :: waited 0.039s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:31 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15444cc-86e8-4116-bb3f-7ff7b57f02a2]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:31 devstack sudo[103706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:28:31 devstack sudo[103706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:32 devstack sudo[103703]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 1G" returned: 0 in 1.118s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:32 devstack sudo[103712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 Jun 23 04:28:32 devstack sudo[103712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:32 devstack sudo[103706]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.892s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:32 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e Jun 23 04:28:32 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:32 devstack sudo[103712]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" returned: 0 in 0.844s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:32 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 is being set with open permissions: ugo+rw Jun 23 04:28:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:32 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 Jun 23 04:28:32 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:33 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b09834b4-9a56-4ed1-81ea-976c59f8a98e" returned: 0 in 0.749s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Lock "cinder-quobyte-b09834b4-9a56-4ed1-81ea-976c59f8a98e" released by "delete_volume" :: held 1.684s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Created reservations ['8de6cebb-60bf-429b-b885-36609c78d031', '88bc842b-b6d1-4162-bd76-169fbc1a1ace', '8c497481-c12a-4aa8-9737-9e1f9e5f85d7', 'c626d3a6-b47c-4043-8d09-1b1a8f2385cc'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:33 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:33 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:33 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" returned: 0 in 0.734s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:33 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info Jun 23 04:28:33 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:33 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.776s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:33 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Deleted volume successfully. Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c07d2bba-623e-442a-9e89-f6578e3a8694 tempest-VolumesActionsTest-1613227002 None] Lock "cinder-b09834b4-9a56-4ed1-81ea-976c59f8a98e-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:34 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Flow 'volume_create_manager' (417eadc4-c4b7-4a0c-9b9c-23825bd7c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70a950a-a4f4-43de-a9d6-fe55ea824086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info" returned: 0 in 0.944s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:34 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info is being set with open permissions: ugo+rw Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70a950a-a4f4-43de-a9d6-fe55ea824086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-916881378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676a2719-e9ae-408f-8650-0669eb0bd3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a861f75ff1043ebadc8ff90fc0c5160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:35Z,use_quota=True,user_id='0d1a1b1729164facbdc9cdbe3b3d7dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:34 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info Jun 23 04:28:34 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745b1053-6a7f-45b2-a8de-68e04bdc6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (745b1053-6a7f-45b2-a8de-68e04bdc6cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e010b573-70e4-4c4f-bfe1-cdf67ad540de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e010b573-70e4-4c4f-bfe1-cdf67ad540de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '676a2719-e9ae-408f-8650-0669eb0bd3dc', 'volume_name': 'volume-676a2719-e9ae-408f-8650-0669eb0bd3dc', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55f1b68-aa40-47cd-a31d-892e7d1f7a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c55f1b68-aa40-47cd-a31d-892e7d1f7a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea864cd1-85eb-4e1a-9bbb-a9ff2218ce72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:34 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Volume 676a2719-e9ae-408f-8650-0669eb0bd3dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-676a2719-e9ae-408f-8650-0669eb0bd3dc', 'volume_size': 1} Jun 23 04:28:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:35 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.info" returned: 0 in 0.626s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.340s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-916881378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=676a2719-e9ae-408f-8650-0669eb0bd3dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a861f75ff1043ebadc8ff90fc0c5160',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:35Z,use_quota=True,user_id='0d1a1b1729164facbdc9cdbe3b3d7dcb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Creating volume 676a2719-e9ae-408f-8650-0669eb0bd3dc {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:35 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:35 devstack sudo[103736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc 1073741824 Jun 23 04:28:35 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-10dd385b-8503-4528-b1ac-3b422dbe922c tempest-SnapshotMetadataTestJSON-310490636 None] Create snapshot completed successfully Jun 23 04:28:35 devstack sudo[103736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Acquiring lock "cinder-7b9e8db1-80ff-4873-ba52-05376e6ce029-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "cinder-7b9e8db1-80ff-4873-ba52-05376e6ce029-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Acquiring lock "cinder-quobyte-7b9e8db1-80ff-4873-ba52-05376e6ce029" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "cinder-quobyte-7b9e8db1-80ff-4873-ba52-05376e6ce029" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a40573b-6374-44b5-8efa-e2c83af9f5b1]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:36 devstack sudo[103736]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc 1073741824" returned: 0 in 1.190s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:36 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 Jun 23 04:28:36 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:36 devstack sudo[103744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc Jun 23 04:28:36 devstack sudo[103744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "cinder-e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "cinder-quobyte-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-quobyte-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "cinder-quobyte-e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-quobyte-e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Deleting offline snapshot e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 of volume c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] snapshot_file for this snap is: volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5405e94-3597-4c57-a7bb-d7793fdc2dc5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:37 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 Jun 23 04:28:37 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:37 devstack sudo[103744]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc" returned: 0 in 0.882s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] <== create_volume: return (2131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.138s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea864cd1-85eb-4e1a-9bbb-a9ff2218ce72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-676a2719-e9ae-408f-8650-0669eb0bd3dc', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd2f64-1be0-48af-9cc3-a0c4386b3a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:37 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Volume volume-676a2719-e9ae-408f-8650-0669eb0bd3dc (676a2719-e9ae-408f-8650-0669eb0bd3dc): created successfully Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8cd2f64-1be0-48af-9cc3-a0c4386b3a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Flow 'volume_create_manager' (417eadc4-c4b7-4a0c-9b9c-23825bd7c60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0503289f-6f62-432d-b0b8-3cde463c1677 tempest-AbsoluteLimitsTests-1697903783 None] Created volume successfully. Jun 23 04:28:37 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029" returned: 0 in 1.121s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:37 devstack sudo[103754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029 Jun 23 04:28:37 devstack sudo[103754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Acquiring lock "cinder-676a2719-e9ae-408f-8650-0669eb0bd3dc-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Lock "cinder-676a2719-e9ae-408f-8650-0669eb0bd3dc-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Acquiring lock "cinder-quobyte-676a2719-e9ae-408f-8650-0669eb0bd3dc" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Lock "cinder-quobyte-676a2719-e9ae-408f-8650-0669eb0bd3dc" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf02af4f-227b-4ac3-8cbd-8982c3f3bc00]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:38 devstack sudo[103760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc Jun 23 04:28:38 devstack sudo[103760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:38 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" returned: 0 in 1.118s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[379f0117-7a31-4fa2-978d-972d30c8ff0a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:38 devstack sudo[103754]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7b9e8db1-80ff-4873-ba52-05376e6ce029" returned: 0 in 0.939s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "cinder-quobyte-7b9e8db1-80ff-4873-ba52-05376e6ce029" released by "delete_volume" :: held 2.155s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Created reservations ['98e6e566-cd54-43b6-8284-2a1702610326', '4f01b82e-6606-46f7-b3bc-661b8d50f7fb', '1611e524-a750-4e83-91ff-bd253810bcac', '91fa812f-eb68-4c35-9efa-26e4352bd56c'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:38 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f Jun 23 04:28:38 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:38 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:38 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:39 devstack sudo[103760]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc" returned: 0 in 0.917s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:39 devstack sudo[103772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc Jun 23 04:28:39 devstack sudo[103772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:39 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" returned: 0 in 1.085s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:39 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 Jun 23 04:28:39 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:39 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.828s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:39 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Deleted volume successfully. Jun 23 04:28:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7c5ffe5d-93e5-4800-923d-bc3e2ff106cb tempest-AttachVolumeShelveTestJSON-1042863999 None] Lock "cinder-7b9e8db1-80ff-4873-ba52-05376e6ce029-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:40 devstack sudo[103772]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-676a2719-e9ae-408f-8650-0669eb0bd3dc" returned: 0 in 0.845s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Lock "cinder-quobyte-676a2719-e9ae-408f-8650-0669eb0bd3dc" released by "delete_volume" :: held 1.812s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Created reservations ['86634929-414c-49de-9809-795961662f5f', '41236fda-75e0-41c1-90e3-0f95f547a0bb', 'd3fab7c3-f8a2-465b-b087-648b1502b8e0', 'f74ed634-c5ce-48c7-9bc1-9031f7f02d80'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:40 devstack sudo[103784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:40 devstack sudo[103784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:40 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" returned: 0 in 0.917s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:40 devstack sudo[103787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1 Jun 23 04:28:40 devstack sudo[103787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:41 devstack sudo[103784]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.009s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Deleted volume successfully. Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9e7b81a-b278-4ec2-a6c4-51cfe7a73c08 tempest-AbsoluteLimitsTests-1697903783 None] Lock "cinder-676a2719-e9ae-408f-8650-0669eb0bd3dc-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:41 devstack sudo[103787]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f.e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" returned: 0 in 0.996s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-quobyte-e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1" released by "_delete_snapshot" :: held 4.248s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-quobyte-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" released by "delete_snapshot" :: held 4.277s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Created reservations ['8fe63be3-e445-431d-a186-f4b0eb39ae9f', '510b7fa6-5229-4852-9b7f-7162b769e432', '8d9e28fe-b36c-462f-9e1d-6a41f2e6fd82', 'd43edc6e-938c-4824-8851-1edb7c68ccb1'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Delete snapshot completed successfully. Jun 23 04:28:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-30dcb1ea-c052-47e0-9cb5-5928999cbf55 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-e9e8c811-8b2f-4b8d-88cf-999ceb33ddd1-delete_snapshot" released by "delete_snapshot" :: held 4.472s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Flow 'volume_create_manager' (b2c9c24f-2fe4-4e4f-a80d-b5e969707724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8c25c5-3516-4e68-93c9-b9911f58f9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8c25c5-3516-4e68-93c9-b9911f58f9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-11688856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e39696f-6c7a-4723-9448-d30eae452442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca94aea7c1934d83abb6b64cd8d5d47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:42Z,use_quota=True,user_id='5166db3b80ab43f993116445e8c7026d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faafe2b-8182-4287-941f-a8a28dd5d316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5faafe2b-8182-4287-941f-a8a28dd5d316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3567a9e4-ce79-495b-9398-4d2e1c986f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3567a9e4-ce79-495b-9398-4d2e1c986f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e39696f-6c7a-4723-9448-d30eae452442', 'volume_name': 'volume-5e39696f-6c7a-4723-9448-d30eae452442', 'volume_size': 2}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f40185-d79a-47cc-9e17-0767e83ccac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66f40185-d79a-47cc-9e17-0767e83ccac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ea1edd-cef1-4b6e-855f-d09710268007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:42 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Volume 5e39696f-6c7a-4723-9448-d30eae452442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e39696f-6c7a-4723-9448-d30eae452442', 'volume_size': 2} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-11688856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e39696f-6c7a-4723-9448-d30eae452442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca94aea7c1934d83abb6b64cd8d5d47d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:42Z,use_quota=True,user_id='5166db3b80ab43f993116445e8c7026d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Creating volume 5e39696f-6c7a-4723-9448-d30eae452442 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:42 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 2147483648 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:42 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 2147483648 Jun 23 04:28:42 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "cinder-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "cinder-quobyte-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-quobyte-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[943dbc96-1e48-460a-9d7f-33e5b9e4c175]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:42 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f Jun 23 04:28:42 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:43 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 2147483648" returned: 0 in 1.409s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:43 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" returned: 0 in 1.131s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:44 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f Jun 23 04:28:44 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:44 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 Jun 23 04:28:44 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:44 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" returned: 0 in 0.859s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-quobyte-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f" released by "delete_volume" :: held 2.065s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:44 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442" returned: 0 in 0.888s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] <== create_volume: return (2368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ea1edd-cef1-4b6e-855f-d09710268007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e39696f-6c7a-4723-9448-d30eae452442', 'volume_size': 2}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ee9302-53cb-4fd7-913a-2d042e0d26c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:45 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Volume volume-5e39696f-6c7a-4723-9448-d30eae452442 (5e39696f-6c7a-4723-9448-d30eae452442): created successfully Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1ee9302-53cb-4fd7-913a-2d042e0d26c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Flow 'volume_create_manager' (b2c9c24f-2fe4-4e4f-a80d-b5e969707724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Created reservations ['e95db3df-e010-44f0-9a2f-d5d99fcbaca5', 'bb0e6b79-95c3-4c31-bb52-dffe590dcbcd', 'fff9bf4a-1314-4b8a-8686-c05d3fb726fa', '84164cc8-dc2c-4ee8-85be-5443a63af57e'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:45 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a1df4e3e-b5d9-4156-b6b3-eb0dd1eb586c tempest-VolumesCloneNegativeTest-541371101 None] Created volume successfully. Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:45 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:45 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Acquiring lock "cinder-5e39696f-6c7a-4723-9448-d30eae452442-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Lock "cinder-5e39696f-6c7a-4723-9448-d30eae452442-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Acquiring lock "cinder-quobyte-5e39696f-6c7a-4723-9448-d30eae452442" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Lock "cinder-quobyte-5e39696f-6c7a-4723-9448-d30eae452442" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:45 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[caafdfe7-7850-4f36-be0d-dce2088b5fc2]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:45 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Deleted volume successfully. Jun 23 04:28:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9f8f6c0-d29c-4ff9-bf83-9c5ca2fb8b56 tempest-SnapshotMetadataTestJSON-310490636 None] Lock "cinder-c21b94ac-77e6-4ceb-bf9e-98101f6d4a0f-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:46 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 Jun 23 04:28:46 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:46 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442" returned: 0 in 0.933s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:46 devstack sudo[103824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442 Jun 23 04:28:46 devstack sudo[103824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:47 devstack sudo[103824]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e39696f-6c7a-4723-9448-d30eae452442" returned: 0 in 0.845s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Lock "cinder-quobyte-5e39696f-6c7a-4723-9448-d30eae452442" released by "delete_volume" :: held 1.853s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Created reservations ['e37480de-7e77-4a63-8637-beab3648fdbe', '14ffd3fa-8e5e-4d18-9572-093fc5b2d01d', '3c7a0303-fa4c-4b96-8cbd-7c861f2bfe59', 'd595e201-7719-40f2-bb93-2f94e3997d78'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:47 devstack sudo[103827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:47 devstack sudo[103827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:48 devstack sudo[103827]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.839s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:48 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Deleted volume successfully. Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Flow 'volume_create_manager' (7877ad08-99a6-45a0-8eaf-0f9991ae9c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbf6b0d-0a01-42ae-bb95-b1c1016cdb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbf6b0d-0a01-42ae-bb95-b1c1016cdb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1800916901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a455e14-60ea-4f58-9a3b-4fb5c7d48a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd4265530cc4e4fb99e7aa314d878f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:49Z,use_quota=True,user_id='3deb71ab087e40e0844b2ed584aa67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a0a24b-e15c-49ab-a3c6-967dd7b2a85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81a0a24b-e15c-49ab-a3c6-967dd7b2a85b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5881ea6f-98e7-4cf4-a60c-c2d43228cb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5881ea6f-98e7-4cf4-a60c-c2d43228cb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a455e14-60ea-4f58-9a3b-4fb5c7d48a64', 'volume_name': 'volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2674b97f-8acb-428d-b73b-a98581951cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2674b97f-8acb-428d-b73b-a98581951cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6d927a-71a5-40aa-912e-7936ddf3d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Volume 5a455e14-60ea-4f58-9a3b-4fb5c7d48a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64', 'volume_size': 1} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1800916901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a455e14-60ea-4f58-9a3b-4fb5c7d48a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd4265530cc4e4fb99e7aa314d878f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:49Z,use_quota=True,user_id='3deb71ab087e40e0844b2ed584aa67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Creating volume 5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:48 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-915f41e9-bce9-4f88-80f0-0cc2b57256d3 tempest-VolumesCloneNegativeTest-541371101 None] Lock "cinder-5e39696f-6c7a-4723-9448-d30eae452442-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:48 devstack sudo[103831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 1073741824 Jun 23 04:28:48 devstack sudo[103831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:49 devstack sudo[103831]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 1073741824" returned: 0 in 1.045s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:49 devstack sudo[103838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 Jun 23 04:28:49 devstack sudo[103838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6f2cbbb0-6f8a-48d8-9cf9-4207c4ad725f tempest-GroupSnapshotsV319Test-1243799515 None] Group tempest-GroupSnapshotsV319Test-Group-906240239: creating Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6f2cbbb0-6f8a-48d8-9cf9-4207c4ad725f tempest-GroupSnapshotsV319Test-1243799515 None] Group tempest-GroupSnapshotsV319Test-Group-906240239: created successfully Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6f2cbbb0-6f8a-48d8-9cf9-4207c4ad725f tempest-GroupSnapshotsV319Test-1243799515 None] Create group completed successfully. Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (93914593-38a9-475d-943a-4415cf34b7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc8d141-fc04-4809-8a10-22d8643dbaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cc8d141-fc04-4809-8a10-22d8643dbaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-325326441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e323bf2-77fe-475d-b396-36dfde1e8231,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:50Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf05d62-1a11-44ca-9e79-3d19e7cb093b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bf05d62-1a11-44ca-9e79-3d19e7cb093b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d6e93b-45fb-4236-aedb-e55c30ae1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12d6e93b-45fb-4236-aedb-e55c30ae1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e323bf2-77fe-475d-b396-36dfde1e8231', 'volume_name': 'volume-6e323bf2-77fe-475d-b396-36dfde1e8231', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb62c0b5-6da6-4286-a21f-9373547732aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb62c0b5-6da6-4286-a21f-9373547732aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e955e9ea-ac9c-4cef-8adc-3002a7c9306f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Volume 6e323bf2-77fe-475d-b396-36dfde1e8231: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e323bf2-77fe-475d-b396-36dfde1e8231', 'volume_size': 1} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:50 devstack sudo[103838]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64" returned: 0 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.852s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.048s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-325326441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e323bf2-77fe-475d-b396-36dfde1e8231,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:50Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Creating volume 6e323bf2-77fe-475d-b396-36dfde1e8231 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:50 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 1073741824 Jun 23 04:28:50 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e6d927a-71a5-40aa-912e-7936ddf3d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd655609-557f-490f-ae51-cf61e4f04b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Volume volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 (5a455e14-60ea-4f58-9a3b-4fb5c7d48a64): created successfully Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd655609-557f-490f-ae51-cf61e4f04b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Flow 'volume_create_manager' (7877ad08-99a6-45a0-8eaf-0f9991ae9c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a317e1bc-cbc9-48a7-b2d7-d690616f7524 tempest-VolumesTransfersTest-1576905013 None] Created volume successfully. Jun 23 04:28:51 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 1073741824" returned: 0 in 0.885s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:51 devstack sudo[103847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 Jun 23 04:28:51 devstack sudo[103847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Flow 'volume_create_manager' (41e2fe63-9e14-4090-a043-5ece824c6d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d47b277-9e85-42ec-ba32-7b8fea19a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d47b277-9e85-42ec-ba32-7b8fea19a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1301628786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db8a8192-605c-460e-be35-55c9d700ca2c,host='devstack@QuobyteHD#QuobyteHD',id=9c32564c-bafd-4fed-95ba-fe5a517fa91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f612dd5cd74d4595289253a271ff3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:52Z,use_quota=True,user_id='5517cffbc5fa419988bd6c8738c3718f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c26d8fb2-f3fd-4bf6-bf5a-480f0f934fdc),volume_type_id=c26d8fb2-f3fd-4bf6-bf5a-480f0f934fdc)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3199cda3-9e94-4025-b953-1b86d3969abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3199cda3-9e94-4025-b953-1b86d3969abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71229446-e134-4e38-b804-f0b98e6113e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71229446-e134-4e38-b804-f0b98e6113e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c32564c-bafd-4fed-95ba-fe5a517fa91e', 'volume_name': 'volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a542b08-c881-4547-a46b-c33dd85c55ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a542b08-c881-4547-a46b-c33dd85c55ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b310e0b9-f765-4950-90af-3d1400fea134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Volume 9c32564c-bafd-4fed-95ba-fe5a517fa91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e', 'volume_size': 1} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:52 devstack sudo[103847]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231" returned: 0 in 0.802s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db8a8192-605c-460e-be35-55c9d700ca2c,created_at=2026-06-23T02:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1301628786',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db8a8192-605c-460e-be35-55c9d700ca2c,host='devstack@QuobyteHD#QuobyteHD',id=9c32564c-bafd-4fed-95ba-fe5a517fa91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4f612dd5cd74d4595289253a271ff3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:52Z,use_quota=True,user_id='5517cffbc5fa419988bd6c8738c3718f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c26d8fb2-f3fd-4bf6-bf5a-480f0f934fdc),volume_type_id=c26d8fb2-f3fd-4bf6-bf5a-480f0f934fdc)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Creating volume 9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:52 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e955e9ea-ac9c-4cef-8adc-3002a7c9306f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e323bf2-77fe-475d-b396-36dfde1e8231', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:52 devstack sudo[103850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e 1073741824 Jun 23 04:28:52 devstack sudo[103850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f90536a-886b-4aed-883d-571dec9b70ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Volume volume-6e323bf2-77fe-475d-b396-36dfde1e8231 (6e323bf2-77fe-475d-b396-36dfde1e8231): created successfully Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f90536a-886b-4aed-883d-571dec9b70ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (93914593-38a9-475d-943a-4415cf34b7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f1c78367-d5c4-4699-a327-8d020f2a8ec6 tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:28:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8f7c089a-c50c-42fe-a21f-2f171eacaaab tempest-VolumesTransfersTest-1045822439 None] Transfer volume completed successfully. Jun 23 04:28:53 devstack sudo[103850]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e 1073741824" returned: 0 in 1.198s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:53 devstack sudo[103857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e Jun 23 04:28:53 devstack sudo[103857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (fc330fa6-4358-404d-80f6-5145f6c0edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9293f2-7dbe-4727-91e1-9449b04dc402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c9293f2-7dbe-4727-91e1-9449b04dc402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-297674396',display_name='tempest-VolumesGetTest-Volume-11739670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d16de11-148b-4096-b54b-da6ae9f6b782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:54Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936a2ac2-e138-42a9-a29d-05c4c12617a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936a2ac2-e138-42a9-a29d-05c4c12617a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c06891-33bf-4734-8619-a1ebd61f2eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64c06891-33bf-4734-8619-a1ebd61f2eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d16de11-148b-4096-b54b-da6ae9f6b782', 'volume_name': 'volume-2d16de11-148b-4096-b54b-da6ae9f6b782', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135173dc-2c93-4338-b02e-1caf742756fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (135173dc-2c93-4338-b02e-1caf742756fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498dcb44-d0a1-4beb-91b3-4f15c6820a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:53 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Volume 2d16de11-148b-4096-b54b-da6ae9f6b782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d16de11-148b-4096-b54b-da6ae9f6b782', 'volume_size': 1} Jun 23 04:28:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Acquiring lock "cinder-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Acquiring lock "cinder-quobyte-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-quobyte-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64" acquired by "delete_volume" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b831776f-a133-44c1-b85b-ac838a400d42]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:54 devstack sudo[103857]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e" returned: 0 in 0.735s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] <== create_volume: return (2008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:54 devstack sudo[103860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 Jun 23 04:28:54 devstack sudo[103860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.613s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-297674396',display_name='tempest-VolumesGetTest-Volume-11739670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d16de11-148b-4096-b54b-da6ae9f6b782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:54Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Creating volume 2d16de11-148b-4096-b54b-da6ae9f6b782 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:28:54 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b310e0b9-f765-4950-90af-3d1400fea134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e90a1-d5d0-43b7-bfc8-d51c8087d614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:54 devstack sudo[103862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 1073741824 Jun 23 04:28:54 devstack sudo[103862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:54 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Volume volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e (9c32564c-bafd-4fed-95ba-fe5a517fa91e): created successfully Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (661e90a1-d5d0-43b7-bfc8-d51c8087d614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Flow 'volume_create_manager' (41e2fe63-9e14-4090-a043-5ece824c6d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c2d3c593-1c4f-43e8-94e5-47b227c214ea tempest-GroupSnapshotsV319Test-1243799515 None] Created volume successfully. Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:54 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:54 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:55 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] GroupSnapshot 2b8211b7-bf2b-4282-ac7b-3154398fb420: creating. Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Group snapshot 2b8211b7-bf2b-4282-ac7b-3154398fb420: creating. {{(pid=93326) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:55 devstack sudo[103860]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64" returned: 0 in 1.150s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:55 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64 Jun 23 04:28:55 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:55 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.992s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:55 devstack sudo[103862]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 1073741824" returned: 0 in 1.187s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:55 devstack sudo[103910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 Jun 23 04:28:55 devstack sudo[103910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:56 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64" returned: 0 in 0.894s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-quobyte-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64" released by "delete_volume" :: held 2.094s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Created reservations ['4bcf36a5-2486-4745-9fe7-5000c016b06b', 'f67ff0a7-b9bd-46c1-8d90-4c405f6e2d44', 'd484feb1-2a80-4754-a653-235ab56da63d', '489d2a3b-b60f-4a8b-97cf-c727ca3d1e37'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:56 devstack sudo[103910]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782" returned: 0 in 0.827s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.253s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498dcb44-d0a1-4beb-91b3-4f15c6820a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d16de11-148b-4096-b54b-da6ae9f6b782', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff6b10b-a9e3-4078-9233-ca7aed25d867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:56 devstack sudo[103917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:56 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Volume volume-2d16de11-148b-4096-b54b-da6ae9f6b782 (2d16de11-148b-4096-b54b-da6ae9f6b782): created successfully Jun 23 04:28:56 devstack sudo[103917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ff6b10b-a9e3-4078-9233-ca7aed25d867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (fc330fa6-4358-404d-80f6-5145f6c0edd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Creating offline snapshot da7b86ed-8c79-433e-acca-fd7a1413f969 of volume 9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f6c1f0-0257-42f2-84dc-3ca9fae2f6a9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-02dc3498-6d00-4789-aef1-465c7544829f tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:28:56 devstack sudo[103919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e Jun 23 04:28:56 devstack sudo[103919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-2d16de11-148b-4096-b54b-da6ae9f6b782-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Lock "cinder-2d16de11-148b-4096-b54b-da6ae9f6b782-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-2d16de11-148b-4096-b54b-da6ae9f6b782" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-2d16de11-148b-4096-b54b-da6ae9f6b782" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dacf51-5ddc-4c11-bded-f5fa22154ab7]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:57 devstack sudo[103917]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:28:57 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Deleted volume successfully. Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-91e39791-b6c1-478b-ab9d-e596c5d516d9 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-5a455e14-60ea-4f58-9a3b-4fb5c7d48a64-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:57 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 Jun 23 04:28:57 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:57 devstack sudo[103919]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e" returned: 0 in 0.998s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:57 devstack sudo[103927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 1G Jun 23 04:28:57 devstack sudo[103927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:28:58 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Flow 'volume_create_manager' (e595d048-f412-4257-8c46-f7e7e5454ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594e41ed-a47a-451f-a4cf-d74dcd5c8a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782" returned: 0 in 1.030s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594e41ed-a47a-451f-a4cf-d74dcd5c8a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-612640471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefbbaa4-4b39-4745-a5dd-994f8041d2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd4265530cc4e4fb99e7aa314d878f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:58Z,use_quota=True,user_id='3deb71ab087e40e0844b2ed584aa67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d9d168-b00b-45bd-bca1-22e9f07db437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:58 devstack sudo[103933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782 Jun 23 04:28:58 devstack sudo[103933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d9d168-b00b-45bd-bca1-22e9f07db437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55847bea-e087-45f7-a17d-c64bd126ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55847bea-e087-45f7-a17d-c64bd126ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eefbbaa4-4b39-4745-a5dd-994f8041d2f5', 'volume_name': 'volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d215bab-9df1-4174-b091-f45f6b5fc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d215bab-9df1-4174-b091-f45f6b5fc007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6315a5c-392b-4f72-bd63-0735c3faaf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:28:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Volume eefbbaa4-4b39-4745-a5dd-994f8041d2f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5', 'volume_size': 1} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:58 devstack sudo[103927]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 1G" returned: 0 in 1.041s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:58 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 Jun 23 04:28:58 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:59 devstack sudo[103933]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d16de11-148b-4096-b54b-da6ae9f6b782" returned: 0 in 0.807s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-2d16de11-148b-4096-b54b-da6ae9f6b782" released by "delete_volume" :: held 1.898s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Created reservations ['43d5f11c-3581-4070-b66f-f8ef916a1078', '4c10958e-ed2c-40dc-af74-26825deacb08', '185a1020-5847-4deb-ae49-3153371792c4', '37a6b4a6-02da-44d9-b6cd-87faede1e681'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:59 devstack sudo[103942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:28:59 devstack sudo[103942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-6e323bf2-77fe-475d-b396-36dfde1e8231-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Lock "cinder-6e323bf2-77fe-475d-b396-36dfde1e8231-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:59 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969" returned: 0 in 0.880s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:28:59 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-6e323bf2-77fe-475d-b396-36dfde1e8231" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:28:59 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 Jun 23 04:28:59 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-6e323bf2-77fe-475d-b396-36dfde1e8231" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd514722-0ea0-411f-ac7d-f0a5d298d6b6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:28:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:28:59 devstack sudo[103949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 Jun 23 04:28:59 devstack sudo[103949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:00 devstack sudo[103942]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.799s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e6c33220-36d8-40ad-84f4-af9ebe745654 tempest-VolumesGetTest-2000948514 None] Lock "cinder-2d16de11-148b-4096-b54b-da6ae9f6b782-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:00 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969" returned: 0 in 0.971s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:00 devstack sudo[103955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info Jun 23 04:29:00 devstack sudo[103955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:00 devstack sudo[103949]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231" returned: 0 in 1.039s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:00 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231 Jun 23 04:29:00 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:01 devstack sudo[103955]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info" returned: 0 in 0.694s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:01 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:01 devstack sudo[103962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info Jun 23 04:29:01 devstack sudo[103962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:01 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6e323bf2-77fe-475d-b396-36dfde1e8231" returned: 0 in 0.698s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-6e323bf2-77fe-475d-b396-36dfde1e8231" released by "delete_volume" :: held 1.793s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Created reservations ['6cbdb6fe-ebc8-4f47-8beb-9e883ddbb6ca', '77335057-2809-470a-949c-fdc295a45642', 'd9bf787f-d886-41fa-8b48-13317156e863', '1cd1856d-5eda-4c28-9b3e-b194c5af3ba7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:01 devstack sudo[103964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:01 devstack sudo[103964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:02 devstack sudo[103962]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.info" returned: 0 in 0.792s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.605s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.705s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-612640471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eefbbaa4-4b39-4745-a5dd-994f8041d2f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dd4265530cc4e4fb99e7aa314d878f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:28:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:28:58Z,use_quota=True,user_id='3deb71ab087e40e0844b2ed584aa67bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Creating volume eefbbaa4-4b39-4745-a5dd-994f8041d2f5 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:02 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:02 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 1073741824 Jun 23 04:29:02 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-523f5a55-fa20-489a-b513-bcf38d6b2db5 tempest-GroupSnapshotsV319Test-1243799515 None] group_snapshot 2b8211b7-bf2b-4282-ac7b-3154398fb420: created successfully Jun 23 04:29:02 devstack sudo[103964]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.830s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3e13dc1b-6c25-4bb4-a70b-c8a38fda29a7 tempest-VolumesGetTest-2000948514 None] Lock "cinder-6e323bf2-77fe-475d-b396-36dfde1e8231-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (a6fdd4c0-6f23-4939-8dfa-4e1933639faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15cad75-23b9-4262-9e43-a955b9188503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d15cad75-23b9-4262-9e43-a955b9188503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1602096329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd313a58-6792-40b7-914f-075fab3c54f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:02Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73efb6fb-3750-4f43-8474-d9f0f505a317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73efb6fb-3750-4f43-8474-d9f0f505a317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6459b6-51bc-49cc-aafe-92707aa63fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6459b6-51bc-49cc-aafe-92707aa63fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd313a58-6792-40b7-914f-075fab3c54f8', 'volume_name': 'volume-bd313a58-6792-40b7-914f-075fab3c54f8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c4da90-b9a1-4ac9-ae2c-67067352688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4c4da90-b9a1-4ac9-ae2c-67067352688a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe201c2-032e-4a0b-8265-f59573497166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:02 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Volume bd313a58-6792-40b7-914f-075fab3c54f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd313a58-6792-40b7-914f-075fab3c54f8', 'volume_size': 1} Jun 23 04:29:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:03 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] group_snapshot 2b8211b7-bf2b-4282-ac7b-3154398fb420: deleting Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] group_snapshot 2b8211b7-bf2b-4282-ac7b-3154398fb420: deleting {{(pid=93326) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "cinder-quobyte-9c32564c-bafd-4fed-95ba-fe5a517fa91e" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Lock "cinder-quobyte-9c32564c-bafd-4fed-95ba-fe5a517fa91e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "cinder-quobyte-da7b86ed-8c79-433e-acca-fd7a1413f969" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Lock "cinder-quobyte-da7b86ed-8c79-433e-acca-fd7a1413f969" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Deleting offline snapshot da7b86ed-8c79-433e-acca-fd7a1413f969 of volume 9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:29:03 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] snapshot_file for this snap is: volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 1073741824" returned: 0 in 1.194s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0568180c-57dd-4029-8f8b-d4e363322cb4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:03 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 Jun 23 04:29:03 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:03 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 Jun 23 04:29:03 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:04 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5" returned: 0 in 0.748s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1602096329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd313a58-6792-40b7-914f-075fab3c54f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:02Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Creating volume bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:04 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6315a5c-392b-4f72-bd63-0735c3faaf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:04 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 1073741824 Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a7764c-d3d3-4476-8486-c94dee99f117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:04 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:04 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Volume volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 (eefbbaa4-4b39-4745-a5dd-994f8041d2f5): created successfully Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a7764c-d3d3-4476-8486-c94dee99f117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:04 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Flow 'volume_create_manager' (e595d048-f412-4257-8c46-f7e7e5454ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969" returned: 0 in 0.930s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:29:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-878c1210-5f41-40ae-b37f-2b56f009f194 tempest-VolumesTransfersTest-1576905013 None] Created volume successfully. Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c218084-6b79-42d8-a67f-196a5f467b73]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:04 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e Jun 23 04:29:04 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Acquiring lock "cinder-eefbbaa4-4b39-4745-a5dd-994f8041d2f5-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-eefbbaa4-4b39-4745-a5dd-994f8041d2f5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=88,cinder:UPDATE=109,cinder:DELETE=14,cinder:INSERT=35 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=115,cinder:INSERT=28,cinder:SELECT=93,cinder:DELETE=5 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Acquiring lock "cinder-quobyte-eefbbaa4-4b39-4745-a5dd-994f8041d2f5" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-quobyte-eefbbaa4-4b39-4745-a5dd-994f8041d2f5" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[802dafb4-9e52-4d1f-b9d2-ff885decc071]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:05 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 1073741824" returned: 0 in 1.098s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:05 devstack sudo[103989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 Jun 23 04:29:05 devstack sudo[103989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:05 devstack sudo[103995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:05 devstack sudo[103995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:05 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e" returned: 0 in 1.145s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:05 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 Jun 23 04:29:05 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:06 devstack sudo[103995]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 0.881s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:06 devstack sudo[103989]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe201c2-032e-4a0b-8265-f59573497166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd313a58-6792-40b7-914f-075fab3c54f8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609f5648-7bab-4eee-a4d9-aa1988d0836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5" returned: 0 in 1.082s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Volume volume-bd313a58-6792-40b7-914f-075fab3c54f8 (bd313a58-6792-40b7-914f-075fab3c54f8): created successfully Jun 23 04:29:06 devstack sudo[104005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5 Jun 23 04:29:06 devstack sudo[104005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (609f5648-7bab-4eee-a4d9-aa1988d0836f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (a6fdd4c0-6f23-4939-8dfa-4e1933639faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-207c38bb-1305-4632-be8d-b2d12ad89116 tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:29:06 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969" returned: 0 in 1.086s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:06 devstack sudo[104008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969 Jun 23 04:29:06 devstack sudo[104008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:07 devstack sudo[104005]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eefbbaa4-4b39-4745-a5dd-994f8041d2f5" returned: 0 in 0.828s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-quobyte-eefbbaa4-4b39-4745-a5dd-994f8041d2f5" released by "delete_volume" :: held 1.983s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Created reservations ['8a675c07-fa4f-4b4a-9c13-b7300ff00f61', '2e56ae18-389e-47af-9652-0662421bc473', '07559668-1ca3-4e1f-b562-a6893d49365a', '5b582faa-9d70-4aa4-950b-4374bbc53f53'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:07 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:07 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (5c8e53fd-5124-4ceb-b39d-3449b3663c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b3073e-441f-4e67-8158-0987a7550527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:07 devstack sudo[104008]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9b3073e-441f-4e67-8158-0987a7550527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1810931669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=bd313a58-6792-40b7-914f-075fab3c54f8,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:07Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba85b9f0-7995-4171-82b1-30a1fd3c4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba85b9f0-7995-4171-82b1-30a1fd3c4095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103d4335-7c5e-45a9-a5ae-1a86f0ed8732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e.da7b86ed-8c79-433e-acca-fd7a1413f969" returned: 0 in 1.103s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (103d4335-7c5e-45a9-a5ae-1a86f0ed8732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5', 'volume_name': 'volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5', 'volume_size': 1, 'source_volid': 'bd313a58-6792-40b7-914f-075fab3c54f8', 'source_volstatus': 'available'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c2889-e21f-42ab-8d35-a902a4f5a673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (590c2889-e21f-42ab-8d35-a902a4f5a673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37e083b-3286-4780-a902-6672e4504258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:07 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Volume 31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5', 'volume_size': 1, 'source_volid': 'bd313a58-6792-40b7-914f-075fab3c54f8', 'source_volstatus': 'available'} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Lock "cinder-quobyte-da7b86ed-8c79-433e-acca-fd7a1413f969" released by "_delete_snapshot" :: held 4.446s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Lock "cinder-quobyte-9c32564c-bafd-4fed-95ba-fe5a517fa91e" released by "delete_snapshot" :: held 4.484s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:07 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Cloning volume bd313a58-6792-40b7-914f-075fab3c54f8 to volume 31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Creating offline snapshot a79b3f57-64df-4fdf-87ac-02a8210b6d52 of volume bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:29:07 devstack cinder-volume[93326]: WARNING cinder.quota [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1148626137 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1148626137, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:29:07 devstack cinder-volume[93326]: WARNING cinder.quota [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1148626137 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1148626137, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cfa369-05f6-439c-8196-8c0bb434a0d6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:07 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] Created reservations ['abb90171-800c-48cf-80d3-ccc5642ef3cc', '65195ab2-597f-40f4-a410-b9310be4f392', '82955e12-bd12-4ae0-abfa-c10b16919d2e', '3c5ae343-af6d-4ea4-bded-6a782bc43620'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:08 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:08 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8d61e11f-8a53-473c-8f3c-df859e37efe7 tempest-GroupSnapshotsV319Test-1243799515 None] group_snapshot 2b8211b7-bf2b-4282-ac7b-3154398fb420: deleted successfully Jun 23 04:29:08 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.927s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:08 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Deleted volume successfully. Jun 23 04:29:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b48eea4-ba79-4a29-adec-0803b9e61118 tempest-VolumesTransfersTest-869445240 None] Lock "cinder-eefbbaa4-4b39-4745-a5dd-994f8041d2f5-delete_volume" released by "delete_volume" :: held 3.288s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:08 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 1.071s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:08 devstack sudo[104021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 1G Jun 23 04:29:08 devstack sudo[104021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "cinder-quobyte-9c32564c-bafd-4fed-95ba-fe5a517fa91e" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Lock "cinder-quobyte-9c32564c-bafd-4fed-95ba-fe5a517fa91e" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c117094-4af1-4542-861e-56746a02ac6c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:09 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e Jun 23 04:29:09 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:10 devstack sudo[104021]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 1G" returned: 0 in 1.058s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd313a58-6792-40b7-914f-075fab3c54f8 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:10 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd313a58-6792-40b7-914f-075fab3c54f8 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 Jun 23 04:29:10 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:10 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e" returned: 0 in 1.073s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:10 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e Jun 23 04:29:10 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:10 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd313a58-6792-40b7-914f-075fab3c54f8 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52" returned: 0 in 0.925s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:10 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 is being set with open permissions: ugo+rw Jun 23 04:29:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:10 devstack sudo[104040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 Jun 23 04:29:10 devstack sudo[104040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:11 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9c32564c-bafd-4fed-95ba-fe5a517fa91e" returned: 0 in 0.856s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Lock "cinder-quobyte-9c32564c-bafd-4fed-95ba-fe5a517fa91e" released by "delete_volume" :: held 2.022s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Created reservations ['2d9e42ce-a435-489a-9cff-12e8a6d9be01'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:11 devstack cinder-volume[93326]: WARNING cinder.quota [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1148626137 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1148626137, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Created reservations ['8b42bfdc-b6c3-41ed-892f-0ca194b99839', '99864a1a-3757-4e52-82cd-a87a520c8572', '67140fe8-37f8-4813-95d3-83cdd3da671a', '72d04df8-88ae-483f-b6b5-1db13c3af9fc'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:11 devstack sudo[104043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:11 devstack sudo[104043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:11 devstack sudo[104040]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52" returned: 0 in 1.023s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:12 devstack sudo[104046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info Jun 23 04:29:12 devstack sudo[104046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:12 devstack sudo[104043]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.028s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:12 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:12 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-74150a1c-f9ad-4e3c-9b19-6454fde4696e tempest-GroupSnapshotsV319Test-1243799515 None] Delete group completed successfully. Jun 23 04:29:13 devstack sudo[104046]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info" returned: 0 in 1.049s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:13 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info is being set with open permissions: ugo+rw Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:13 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info Jun 23 04:29:13 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:13 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.info" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] snapshot: a79b3f57-64df-4fdf-87ac-02a8210b6d52, volume: 31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37495f41-c289-462a-a339-4f5269356ab3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:14 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 Jun 23 04:29:14 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:14 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52" returned: 0 in 0.992s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd313a58-6792-40b7-914f-075fab3c54f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:29:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:29:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:29:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48b0fe5-6e6d-4d01-8b6f-adb50fa33d07]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:15 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:15 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:15 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 0.986s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:16 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:29:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:16 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 Jun 23 04:29:16 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:21 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=20,cinder:UPDATE=32,cinder:INSERT=7 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:29:22 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:29:23 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" returned: 0 in 7.241s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:23 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cac8cfc-b61f-4f15-96e9-001608485823]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:23 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:23 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Flow 'volume_create_manager' (5aae9306-eb6b-4f9e-b5e5-fdefd571602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1e6152-2efd-4837-99e8-ffd53db98302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce1e6152-2efd-4837-99e8-ffd53db98302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-608000993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26165d0f-6e2c-41fe-b119-a513c08569ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97efc8b711314ff79e8dc984aaabcfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:24Z,use_quota=True,user_id='612795fe8dcd4c49a651e6c2ecd1327d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05ccf22-ea1d-4bfd-8a75-993cd458e6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05ccf22-ea1d-4bfd-8a75-993cd458e6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce729c6-9d2d-47ce-a2ed-0dcf25e10012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce729c6-9d2d-47ce-a2ed-0dcf25e10012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26165d0f-6e2c-41fe-b119-a513c08569ab', 'volume_name': 'volume-26165d0f-6e2c-41fe-b119-a513c08569ab', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8d33c5-cab4-4314-82fd-bf1d9c6898c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8d33c5-cab4-4314-82fd-bf1d9c6898c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26308d7-5fad-496f-a0eb-8e4346968b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:24 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Volume 26165d0f-6e2c-41fe-b119-a513c08569ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26165d0f-6e2c-41fe-b119-a513c08569ab', 'volume_size': 1} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:24 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 1.309s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8, size 1024.00 MB, duration 7.24 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:29:24 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Converted 1024.00 MB image at 141.40 MB/s Jun 23 04:29:24 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 is being set with open permissions: ugo+rw Jun 23 04:29:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:24 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 Jun 23 04:29:24 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:25 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" returned: 0 in 0.701s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" released by "_copy_volume_from_snapshot" :: held 11.373s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-a79b3f57-64df-4fdf-87ac-02a8210b6d52" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-a79b3f57-64df-4fdf-87ac-02a8210b6d52" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Deleting offline snapshot a79b3f57-64df-4fdf-87ac-02a8210b6d52 of volume bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] snapshot_file for this snap is: volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62df86e-2f07-40a7-8f53-628f1ce8cdb0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:25 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 Jun 23 04:29:25 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:26 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52" returned: 0 in 0.880s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd313a58-6792-40b7-914f-075fab3c54f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:29:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9388955-5995-47a8-a2d8-2e16da27b155]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:26 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:26 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:27 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 0.812s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:27 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 Jun 23 04:29:27 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Flow 'volume_create_manager' (d5274234-4002-4a37-9992-619749bb0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e02d860-44a0-4139-84cc-f64eb8a9add1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e02d860-44a0-4139-84cc-f64eb8a9add1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1983687761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094417c0-dc82-4d4b-89a2-d1f52a701cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8f5a987ee46a1b608d7022c133680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:28Z,use_quota=True,user_id='b2a2a26ef74245f3be9b3d44bb8787a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb59ed10-22d1-44e0-9277-ed92380ec91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb59ed10-22d1-44e0-9277-ed92380ec91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf9fb14-3993-470d-85eb-8e22d9baf5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf9fb14-3993-470d-85eb-8e22d9baf5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '094417c0-dc82-4d4b-89a2-d1f52a701cec', 'volume_name': 'volume-094417c0-dc82-4d4b-89a2-d1f52a701cec', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b2977f-4d35-4831-97d9-ca3c6c29b031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1b2977f-4d35-4831-97d9-ca3c6c29b031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6577a87-8a51-49f7-adbe-3e43031cc9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:27 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Volume 094417c0-dc82-4d4b-89a2-d1f52a701cec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-094417c0-dc82-4d4b-89a2-d1f52a701cec', 'volume_size': 1} Jun 23 04:29:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:28 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52" returned: 0 in 0.956s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:28 devstack sudo[104105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52 Jun 23 04:29:28 devstack sudo[104105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:28 devstack sudo[104105]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8.a79b3f57-64df-4fdf-87ac-02a8210b6d52" returned: 0 in 0.698s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-a79b3f57-64df-4fdf-87ac-02a8210b6d52" released by "_delete_snapshot" :: held 3.486s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 21.099s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.558s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-608000993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26165d0f-6e2c-41fe-b119-a513c08569ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97efc8b711314ff79e8dc984aaabcfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:24Z,use_quota=True,user_id='612795fe8dcd4c49a651e6c2ecd1327d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Creating volume 26165d0f-6e2c-41fe-b119-a513c08569ab {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:28 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:28 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab 1073741824 Jun 23 04:29:28 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b37e083b-3286-4780-a902-6672e4504258) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5', 'volume_size': 1, 'source_volid': 'bd313a58-6792-40b7-914f-075fab3c54f8', 'source_volstatus': 'available'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d1a13f-ecf7-4541-9afb-c7bb8053a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:28 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Volume volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 (31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5): created successfully Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26d1a13f-ecf7-4541-9afb-c7bb8053a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (5c8e53fd-5124-4ceb-b39d-3449b3663c74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:29 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3648b975-7619-44d5-8c03-4be2d3ff9c81 tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:29:29 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab 1073741824" returned: 0 in 1.108s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:30 devstack sudo[104119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab Jun 23 04:29:30 devstack sudo[104119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (1fdaefe9-5fbf-4181-914f-1750ca2ca414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a75b7c-80fb-4807-901b-bdc9a6f786cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51a75b7c-80fb-4807-901b-bdc9a6f786cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1543274736',display_name='tempest-VolumesGetTest-Volume-2101414959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7c8cb5-51df-48f8-9d61-9cd4726d99f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:31Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b063ee8-9385-47f2-b199-5745108fa2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b063ee8-9385-47f2-b199-5745108fa2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c95b08-cc3b-4088-b9f1-522223334ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2c95b08-cc3b-4088-b9f1-522223334ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d7c8cb5-51df-48f8-9d61-9cd4726d99f9', 'volume_name': 'volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4342d501-90e7-4d1b-af9c-dcae998a85a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4342d501-90e7-4d1b-af9c-dcae998a85a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebda5a5-f572-45e7-b6bd-0a584f747dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:30 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Volume 7d7c8cb5-51df-48f8-9d61-9cd4726d99f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9', 'volume_size': 1} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:30 devstack sudo[104119]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab" returned: 0 in 0.804s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.910s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1983687761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=094417c0-dc82-4d4b-89a2-d1f52a701cec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8f5a987ee46a1b608d7022c133680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:28Z,use_quota=True,user_id='b2a2a26ef74245f3be9b3d44bb8787a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Creating volume 094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:30 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:30 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec 1073741824 Jun 23 04:29:30 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c26308d7-5fad-496f-a0eb-8e4346968b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26165d0f-6e2c-41fe-b119-a513c08569ab', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7346fb2-262c-4196-a101-2e4e9d55a33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3514a90-6634-41ab-9af5-09f32c1782f9 tempest-GroupsTest-2076988703 None] Group tempest-Group1-417567434: creating Jun 23 04:29:31 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Volume volume-26165d0f-6e2c-41fe-b119-a513c08569ab (26165d0f-6e2c-41fe-b119-a513c08569ab): created successfully Jun 23 04:29:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7346fb2-262c-4196-a101-2e4e9d55a33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Flow 'volume_create_manager' (5aae9306-eb6b-4f9e-b5e5-fdefd571602a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3fe92562-1d6d-4eed-93b7-cfccc1679a64 tempest-VolumesTransfersV357Test-956797422 None] Created volume successfully. Jun 23 04:29:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3514a90-6634-41ab-9af5-09f32c1782f9 tempest-GroupsTest-2076988703 None] Group tempest-Group1-417567434: created successfully Jun 23 04:29:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3514a90-6634-41ab-9af5-09f32c1782f9 tempest-GroupsTest-2076988703 None] Create group completed successfully. Jun 23 04:29:31 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec 1073741824" returned: 0 in 0.841s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:31 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:29:31 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-05636ed6-be0e-4d0b-879c-ed645da93b69 tempest-GroupsTest-2076988703 None] Group tempest-Group2-1561553671: creating Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-05636ed6-be0e-4d0b-879c-ed645da93b69 tempest-GroupsTest-2076988703 None] Group tempest-Group2-1561553671: created successfully Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-05636ed6-be0e-4d0b-879c-ed645da93b69 tempest-GroupsTest-2076988703 None] Create group completed successfully. Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3ceda60-6a0b-440a-88ef-46c45594248b tempest-VolumesTransfersV357Test-1586263256 None] Transfer volume completed successfully. Jun 23 04:29:32 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 0.681s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.674s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:30Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1543274736',display_name='tempest-VolumesGetTest-Volume-2101414959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d7c8cb5-51df-48f8-9d61-9cd4726d99f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:31Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Creating volume 7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6577a87-8a51-49f7-adbe-3e43031cc9e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-094417c0-dc82-4d4b-89a2-d1f52a701cec', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:32 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 1073741824 Jun 23 04:29:32 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2108a7ee-a186-4f6c-ae53-170fc5ec7116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Volume volume-094417c0-dc82-4d4b-89a2-d1f52a701cec (094417c0-dc82-4d4b-89a2-d1f52a701cec): created successfully Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2108a7ee-a186-4f6c-ae53-170fc5ec7116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Flow 'volume_create_manager' (d5274234-4002-4a37-9992-619749bb0754) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ab03ac34-0969-4929-b1d2-be4e830b8606 tempest-TestStampPattern-717296437 None] Created volume successfully. Jun 23 04:29:33 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 1073741824" returned: 0 in 0.893s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:33 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Acquiring lock "cinder-26165d0f-6e2c-41fe-b119-a513c08569ab-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:33 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-26165d0f-6e2c-41fe-b119-a513c08569ab-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Acquiring lock "cinder-quobyte-26165d0f-6e2c-41fe-b119-a513c08569ab" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-quobyte-26165d0f-6e2c-41fe-b119-a513c08569ab" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea57aabe-27aa-4672-8d71-9bf80a76d26a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:33 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab Jun 23 04:29:33 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:33 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Flow 'volume_create_manager' (236d89e8-3800-4238-a278-f71ccb29f969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c29e5d8-c61a-4939-868f-17aede56e639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c29e5d8-c61a-4939-868f-17aede56e639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851124754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3d63fdb-09b9-46c7-b170-0141837d8c61,host='devstack@QuobyteHD#QuobyteHD',id=afee29ed-8475-4167-bffd-7a4271639553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d42cd0d30843e6a70834cba1db0a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:34Z,use_quota=True,user_id='f37a3ae43865449195799e5e5db2253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c6651f-1790-475a-a872-12c13d66dea2),volume_type_id=05c6651f-1790-475a-a872-12c13d66dea2)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de5c812-a93b-4e9b-b06f-b7776bc540cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de5c812-a93b-4e9b-b06f-b7776bc540cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c7e76c-4b06-4042-bec7-85d56f2ddf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c7e76c-4b06-4042-bec7-85d56f2ddf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afee29ed-8475-4167-bffd-7a4271639553', 'volume_name': 'volume-afee29ed-8475-4167-bffd-7a4271639553', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da8cd10-4276-47bf-83b6-f18b95bdea71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da8cd10-4276-47bf-83b6-f18b95bdea71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6602ae4-10d3-49ab-a20e-8c9dc5ef2b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:34 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Volume afee29ed-8475-4167-bffd-7a4271639553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afee29ed-8475-4167-bffd-7a4271639553', 'volume_size': 1} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:34 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9" returned: 0 in 0.819s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d3d63fdb-09b9-46c7-b170-0141837d8c61,created_at=2026-06-23T02:29:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-851124754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d3d63fdb-09b9-46c7-b170-0141837d8c61,host='devstack@QuobyteHD#QuobyteHD',id=afee29ed-8475-4167-bffd-7a4271639553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d42cd0d30843e6a70834cba1db0a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:34Z,use_quota=True,user_id='f37a3ae43865449195799e5e5db2253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05c6651f-1790-475a-a872-12c13d66dea2),volume_type_id=05c6651f-1790-475a-a872-12c13d66dea2)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Creating volume afee29ed-8475-4167-bffd-7a4271639553 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:34 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:34 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 1073741824 Jun 23 04:29:34 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ebda5a5-f572-45e7-b6bd-0a584f747dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923dfd9f-41a4-4475-a913-f86c3d0619ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:34 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Volume volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 (7d7c8cb5-51df-48f8-9d61-9cd4726d99f9): created successfully Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (923dfd9f-41a4-4475-a913-f86c3d0619ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (1fdaefe9-5fbf-4181-914f-1750ca2ca414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:34 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5209a1e2-6ba6-4099-beb1-6ba09b794fad tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:29:34 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab" returned: 0 in 0.938s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:34 devstack sudo[104147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab Jun 23 04:29:34 devstack sudo[104147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Lock "cinder-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f749c-2308-423b-8c4f-ab7943d0f6c5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:35 devstack sudo[104147]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-26165d0f-6e2c-41fe-b119-a513c08569ab" returned: 0 in 0.838s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-quobyte-26165d0f-6e2c-41fe-b119-a513c08569ab" released by "delete_volume" :: held 1.834s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Created reservations ['ac3c2735-28d6-4fe6-8e8a-f31dae165587', '6c234a1c-19b1-422b-843d-1fec7ba9a9b0', '064bf850-e263-4c61-8030-c22f7b690454', '87735401-c6fa-4bc7-8e29-b4570167503a'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:35 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 1073741824" returned: 0 in 1.288s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:35 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 Jun 23 04:29:35 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:35 devstack sudo[104156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:35 devstack sudo[104156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:35 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 Jun 23 04:29:35 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:36 devstack sudo[104156]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.108s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:36 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Deleted volume successfully. Jun 23 04:29:36 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9" returned: 0 in 1.478s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-583f14bf-c1ed-4f97-b1c2-13793e13ec5a tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-26165d0f-6e2c-41fe-b119-a513c08569ab-delete_volume" released by "delete_volume" :: held 3.357s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:36 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9 Jun 23 04:29:36 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Flow 'volume_create_manager' (13b0573e-1e7a-48eb-9a04-e1897aea6ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6628a80c-5d50-4044-b3fd-469bbf32f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6628a80c-5d50-4044-b3fd-469bbf32f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1975740670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e687c4-e094-4c0d-b92c-cd147c17929f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97efc8b711314ff79e8dc984aaabcfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:37Z,use_quota=True,user_id='612795fe8dcd4c49a651e6c2ecd1327d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff0a77f-d78f-4231-91a9-b1a0720a3d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ff0a77f-d78f-4231-91a9-b1a0720a3d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675d6086-cfe1-4ffa-9a5a-d4ecf2e18def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675d6086-cfe1-4ffa-9a5a-d4ecf2e18def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56e687c4-e094-4c0d-b92c-cd147c17929f', 'volume_name': 'volume-56e687c4-e094-4c0d-b92c-cd147c17929f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7100abcc-b438-4589-b94d-99607a306cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7100abcc-b438-4589-b94d-99607a306cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b7c63f-aec2-4ef5-88f6-e14b100cb5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:36 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Volume 56e687c4-e094-4c0d-b92c-cd147c17929f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56e687c4-e094-4c0d-b92c-cd147c17929f', 'volume_size': 1} Jun 23 04:29:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:37 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553" returned: 0 in 1.434s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] <== create_volume: return (2845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.849s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.090s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1975740670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56e687c4-e094-4c0d-b92c-cd147c17929f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97efc8b711314ff79e8dc984aaabcfa5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:37Z,use_quota=True,user_id='612795fe8dcd4c49a651e6c2ecd1327d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Creating volume 56e687c4-e094-4c0d-b92c-cd147c17929f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:37 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:37 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f 1073741824 Jun 23 04:29:37 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6602ae4-10d3-49ab-a20e-8c9dc5ef2b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afee29ed-8475-4167-bffd-7a4271639553', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e42b228-26e6-4cdc-a2c9-6b356cc29c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:37 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Volume volume-afee29ed-8475-4167-bffd-7a4271639553 (afee29ed-8475-4167-bffd-7a4271639553): created successfully Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e42b228-26e6-4cdc-a2c9-6b356cc29c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Flow 'volume_create_manager' (236d89e8-3800-4238-a278-f71ccb29f969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d3ea24aa-142a-497b-9f11-525b8c231bb8 tempest-GroupsTest-2076988703 None] Created volume successfully. Jun 23 04:29:37 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9" returned: 0 in 0.764s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9" released by "delete_volume" :: held 2.338s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Created reservations ['2df7e4ab-d9c9-47d0-bb85-6363a69ac664', '4828b271-68db-4d3b-9862-8c59f8bee1ad', 'f9bc4541-a5cf-40a1-ae8b-ca61340a6dd6', 'f1a17da6-548f-432e-9781-6b08245ee5e0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:37 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:37 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:38 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f 1073741824" returned: 0 in 0.938s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:38 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f Jun 23 04:29:38 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:38 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.690s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14691b6b-1dc8-4724-a314-a02a170832cb tempest-VolumesGetTest-2000948514 None] Lock "cinder-7d7c8cb5-51df-48f8-9d61-9cd4726d99f9-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Lock "cinder-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc5045b-faa7-4a3b-b3ac-a56fd1089ad2]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:38 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f" returned: 0 in 0.719s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19b7c63f-aec2-4ef5-88f6-e14b100cb5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56e687c4-e094-4c0d-b92c-cd147c17929f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dbedb0-08b8-492f-a2e8-ec4bd3c56011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:38 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Volume volume-56e687c4-e094-4c0d-b92c-cd147c17929f (56e687c4-e094-4c0d-b92c-cd147c17929f): created successfully Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dbedb0-08b8-492f-a2e8-ec4bd3c56011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Flow 'volume_create_manager' (13b0573e-1e7a-48eb-9a04-e1897aea6ec2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-28481d47-7950-409c-bb42-662b1ce6f8a7 tempest-VolumesTransfersV357Test-956797422 None] Created volume successfully. Jun 23 04:29:38 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 Jun 23 04:29:38 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Acquiring lock "cinder-quobyte-afee29ed-8475-4167-bffd-7a4271639553" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Lock "cinder-quobyte-afee29ed-8475-4167-bffd-7a4271639553" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:39 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[677e8bbf-6f4c-4a19-aa1d-797ecaf0cda3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:39 devstack sudo[104201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 Jun 23 04:29:39 devstack sudo[104201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:39 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" returned: 0 in 0.846s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:39 devstack sudo[104206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5 Jun 23 04:29:39 devstack sudo[104206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:39 devstack sudo[104201]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553" returned: 0 in 0.831s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:39 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553 Jun 23 04:29:39 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Acquiring lock "cinder-56e687c4-e094-4c0d-b92c-cd147c17929f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-56e687c4-e094-4c0d-b92c-cd147c17929f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Acquiring lock "cinder-quobyte-56e687c4-e094-4c0d-b92c-cd147c17929f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-quobyte-56e687c4-e094-4c0d-b92c-cd147c17929f" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df16775-d6cd-484a-88b9-1d952f55001d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:40 devstack sudo[104206]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" returned: 0 in 0.800s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5" released by "delete_volume" :: held 1.713s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Created reservations ['21d02849-aa4b-42eb-8701-865c199d45e0', '705ce5b2-3a6a-412f-9308-1910fb764abf', '88c563d7-af46-4b9c-8656-0bce33efb135', '86e7a618-5ccd-4745-bc5a-74981336f3e3'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:40 devstack sudo[104214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f Jun 23 04:29:40 devstack sudo[104214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:40 devstack sudo[104216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:40 devstack sudo[104216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:40 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-afee29ed-8475-4167-bffd-7a4271639553" returned: 0 in 0.861s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Lock "cinder-quobyte-afee29ed-8475-4167-bffd-7a4271639553" released by "delete_volume" :: held 1.740s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Created reservations ['ff5d84dd-eb22-4c0b-9775-361feb4ac352'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:40 devstack cinder-volume[93326]: WARNING cinder.quota [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1498206016 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1498206016, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:29:40 devstack cinder-volume[93326]: WARNING cinder.quota [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1498206016 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1498206016, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Created reservations ['0c5c7118-d1d6-4fd2-8131-b6a126c48243', '446b014a-afaa-4e50-9859-69e94683cedd', '830d7304-bfa1-4776-acbb-ab165aaf7683', '4cf92171-c718-487e-894c-822844e89c74'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-bd313a58-6792-40b7-914f-075fab3c54f8-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Lock "cinder-bd313a58-6792-40b7-914f-075fab3c54f8-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:41 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-bd313a58-6792-40b7-914f-075fab3c54f8" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:41 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-bd313a58-6792-40b7-914f-075fab3c54f8" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff9c43a-3e9f-41c4-aadd-9b5173f4f701]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:41 devstack sudo[104224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:41 devstack sudo[104224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:41 devstack sudo[104216]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.946s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:41 devstack sudo[104214]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f" returned: 0 in 1.169s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:41 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f Jun 23 04:29:41 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-9342ab66-0b29-41a7-ab34-f4e4e51a9bcd tempest-VolumesGetTest-2000948514 None] Lock "cinder-31edb79f-6464-4ee6-b6e3-8bb5f2b8a1c5-delete_volume" released by "delete_volume" :: held 2.954s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Created reservations ['c71daa96-7c2f-42f7-8f83-b29d64aef9fa'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:41 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:41 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:41 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.825s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:41 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-21c9c0ce-4c85-468f-9a8d-9ff8f845f5ea tempest-GroupsTest-2076988703 None] Delete group completed successfully. Jun 23 04:29:42 devstack sudo[104224]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 0.942s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:42 devstack sudo[104244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8 Jun 23 04:29:42 devstack sudo[104244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:42 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-56e687c4-e094-4c0d-b92c-cd147c17929f" returned: 0 in 0.773s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-quobyte-56e687c4-e094-4c0d-b92c-cd147c17929f" released by "delete_volume" :: held 1.996s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Created reservations ['87531e64-f245-4f91-8591-4d6cb6479154', 'dadabad5-ed5b-4955-a31b-48bd41ab7bec', '23ed06ea-bbf2-4492-a605-91d948657dc3', '613a159c-7367-4d6f-be26-a3d57a73b1af'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:42 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:42 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-64f7ecea-b45f-4f17-9938-3c67e8db1fa4 tempest-GroupsTest-2076988703 None] Delete group completed successfully. Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:42 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:42 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:43 devstack sudo[104244]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bd313a58-6792-40b7-914f-075fab3c54f8" returned: 0 in 1.038s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-bd313a58-6792-40b7-914f-075fab3c54f8" released by "delete_volume" :: held 2.090s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Created reservations ['7a435a02-4377-490d-8796-db321f93c39b', '1b1f98b9-ac00-4de9-ae4e-85079d8750b7', 'fc10360c-2309-4e81-a323-e1539e7bd659', 'bbb7021c-2617-4404-8ff6-38008d4d7bf1'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:43 devstack sudo[104310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:43 devstack sudo[104310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:43 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.347s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-027ab986-c826-4b0d-b819-b8360c06298f tempest-GroupsTest-2076988703 None] Group tempest-GroupsTest-Group-626541757: creating Jun 23 04:29:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Deleted volume successfully. Jun 23 04:29:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea47e8d3-07dd-45d8-9eef-33d693378b4d tempest-VolumesTransfersV357Test-1574324875 None] Lock "cinder-56e687c4-e094-4c0d-b92c-cd147c17929f-delete_volume" released by "delete_volume" :: held 3.765s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:44 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-027ab986-c826-4b0d-b819-b8360c06298f tempest-GroupsTest-2076988703 None] Group tempest-GroupsTest-Group-626541757: created successfully Jun 23 04:29:44 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-027ab986-c826-4b0d-b819-b8360c06298f tempest-GroupsTest-2076988703 None] Create group completed successfully. Jun 23 04:29:44 devstack sudo[104310]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.336s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:44 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:44 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:29:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ea801cb0-6b46-44a7-ba95-0c3e3be2caea tempest-VolumesGetTest-2000948514 None] Lock "cinder-bd313a58-6792-40b7-914f-075fab3c54f8-delete_volume" released by "delete_volume" :: held 3.958s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (d3644eea-34f0-4b81-8d43-a0a157478a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ded4220-2d34-4482-bca7-fe980e26c3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ded4220-2d34-4482-bca7-fe980e26c3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-249960987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816cc834-079a-43d0-b6ac-2092fa737d62,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:46Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d21ac5-726e-4480-8681-ba7d8d84ae4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d21ac5-726e-4480-8681-ba7d8d84ae4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56cbef8-96ac-4a3e-8479-5033f9c121cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:45 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Flow 'volume_create_manager' (5eed7032-8a92-45e4-a678-09c1f2093e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7969cd-30ce-47f1-b755-2a0645f88838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f7969cd-30ce-47f1-b755-2a0645f88838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120430871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=892faeb5-e847-4190-889e-54839257344c,host='devstack@QuobyteHD#QuobyteHD',id=beda3619-c947-430f-adc6-ec1718784260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d42cd0d30843e6a70834cba1db0a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:46Z,use_quota=True,user_id='f37a3ae43865449195799e5e5db2253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3941033b-069b-4cc9-9dfc-19744c8a7589),volume_type_id=3941033b-069b-4cc9-9dfc-19744c8a7589)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0322a362-9ff5-4f45-8502-a5c4d10616fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0322a362-9ff5-4f45-8502-a5c4d10616fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5bd58e-e14b-46a1-8caa-18ff30f7c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5bd58e-e14b-46a1-8caa-18ff30f7c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'beda3619-c947-430f-adc6-ec1718784260', 'volume_name': 'volume-beda3619-c947-430f-adc6-ec1718784260', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f63df1-0ee1-4e9a-8cbe-8c57ddd8139f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f63df1-0ee1-4e9a-8cbe-8c57ddd8139f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f102bc70-6d41-46ca-bfba-e6fa1ed6ae70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Volume beda3619-c947-430f-adc6-ec1718784260: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-beda3619-c947-430f-adc6-ec1718784260', 'volume_size': 1} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=892faeb5-e847-4190-889e-54839257344c,created_at=2026-06-23T02:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1120430871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=892faeb5-e847-4190-889e-54839257344c,host='devstack@QuobyteHD#QuobyteHD',id=beda3619-c947-430f-adc6-ec1718784260,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d42cd0d30843e6a70834cba1db0a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:46Z,use_quota=True,user_id='f37a3ae43865449195799e5e5db2253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3941033b-069b-4cc9-9dfc-19744c8a7589),volume_type_id=3941033b-069b-4cc9-9dfc-19744c8a7589)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Creating volume beda3619-c947-430f-adc6-ec1718784260 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:46 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:46 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 1073741824 Jun 23 04:29:46 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f56cbef8-96ac-4a3e-8479-5033f9c121cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '816cc834-079a-43d0-b6ac-2092fa737d62', 'volume_name': 'volume-816cc834-079a-43d0-b6ac-2092fa737d62', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52fb751-3563-4c22-bc7d-eb27bf4d87c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a52fb751-3563-4c22-bc7d-eb27bf4d87c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7faf909-9958-41fa-8676-136cd3943110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Volume 816cc834-079a-43d0-b6ac-2092fa737d62: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-816cc834-079a-43d0-b6ac-2092fa737d62', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 04:29:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Trying to clone 816cc834-079a-43d0-b6ac-2092fa737d62 from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:29:47 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:29:47 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Image download 20.69 MB at 20.69 MB/s Jun 23 04:29:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6be21e6-0f8b-4639-9dd7-c7fc49a26cb9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:47 devstack sudo[104343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD Jun 23 04:29:47 devstack sudo[104343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:48 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 1073741824" returned: 0 in 1.722s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:48 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 Jun 23 04:29:48 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:48 devstack sudo[104343]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD" returned: 0 in 1.361s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:48 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 is fetched for user c605bd80341049a18afa46dd1c4f635c. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:29:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c43990d-0909-429d-9be2-4ac0995bf6ce]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:49 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD Jun 23 04:29:49 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:49 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260" returned: 0 in 1.244s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] <== create_volume: return (3054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.057s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f102bc70-6d41-46ca-bfba-e6fa1ed6ae70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beda3619-c947-430f-adc6-ec1718784260', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1444857e-3e0f-46c8-bfe5-7fe397726610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Volume volume-beda3619-c947-430f-adc6-ec1718784260 (beda3619-c947-430f-adc6-ec1718784260): created successfully Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1444857e-3e0f-46c8-bfe5-7fe397726610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Flow 'volume_create_manager' (5eed7032-8a92-45e4-a678-09c1f2093e9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:49 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2cc1e32d-728b-474c-ae97-e93f21234476 tempest-GroupsTest-2076988703 None] Created volume successfully. Jun 23 04:29:50 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD" returned: 0 in 1.098s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-249960987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=816cc834-079a-43d0-b6ac-2092fa737d62,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:46Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Creating volume 816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:50 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:50 devstack sudo[104360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 1073741824 Jun 23 04:29:50 devstack sudo[104360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:51 devstack sudo[104360]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 1073741824" returned: 0 in 1.527s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:51 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:29:51 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Flow 'volume_create_manager' (1fa794af-731a-4693-b686-f420ab9f2a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897a7eb2-4786-45cd-ba41-3f23c41c3d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (897a7eb2-4786-45cd-ba41-3f23c41c3d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1371566868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=892faeb5-e847-4190-889e-54839257344c,host='devstack@QuobyteHD#QuobyteHD',id=405627c5-3f48-4c6c-bda1-a48f0c48b74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d42cd0d30843e6a70834cba1db0a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:52Z,use_quota=True,user_id='f37a3ae43865449195799e5e5db2253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3941033b-069b-4cc9-9dfc-19744c8a7589),volume_type_id=3941033b-069b-4cc9-9dfc-19744c8a7589)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0d0dd0-312d-42fb-95cb-a554ca8e2c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f0d0dd0-312d-42fb-95cb-a554ca8e2c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617b8604-d9df-4611-b927-db7803a432e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (617b8604-d9df-4611-b927-db7803a432e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '405627c5-3f48-4c6c-bda1-a48f0c48b74c', 'volume_name': 'volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf78f868-77ff-493a-b1a0-6e0fbea21094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf78f868-77ff-493a-b1a0-6e0fbea21094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2c3deb-d51c-4645-b7fa-2d57760588a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Volume 405627c5-3f48-4c6c-bda1-a48f0c48b74c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c', 'volume_size': 1} Jun 23 04:29:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:52 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 0 in 0.985s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.593s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.799s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=892faeb5-e847-4190-889e-54839257344c,created_at=2026-06-23T02:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1371566868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=892faeb5-e847-4190-889e-54839257344c,host='devstack@QuobyteHD#QuobyteHD',id=405627c5-3f48-4c6c-bda1-a48f0c48b74c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d42cd0d30843e6a70834cba1db0a55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:52Z,use_quota=True,user_id='f37a3ae43865449195799e5e5db2253c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3941033b-069b-4cc9-9dfc-19744c8a7589),volume_type_id=3941033b-069b-4cc9-9dfc-19744c8a7589)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Creating volume 405627c5-3f48-4c6c-bda1-a48f0c48b74c {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:52 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Attempting download of 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume 816cc834-079a-43d0-b6ac-2092fa737d62. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:29:52 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c 1073741824 Jun 23 04:29:52 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd66987-d78d-46be-99de-120f741bfc71]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:53 devstack sudo[104373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz Jun 23 04:29:53 devstack sudo[104373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Flow 'volume_create_manager' (40a5d75e-0e72-4cbd-abc9-84e28ae8e65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572669da-14fa-4bd9-af80-6eefe919c792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (572669da-14fa-4bd9-af80-6eefe919c792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-917652987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03f3713-df4a-44a4-854a-52e36a2f3de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481702cc01a040ccb930021f8767bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:54Z,use_quota=True,user_id='3f8e527ca8044f1a941ddf12c2bace14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb27c94-b16e-4a8a-995d-8fbeb54dbba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fb27c94-b16e-4a8a-995d-8fbeb54dbba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd30fb2-3954-4b66-ae0d-c7b97b3a2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfd30fb2-3954-4b66-ae0d-c7b97b3a2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03f3713-df4a-44a4-854a-52e36a2f3de8', 'volume_name': 'volume-a03f3713-df4a-44a4-854a-52e36a2f3de8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e2b911-9c19-474d-88ba-8a4ab7538884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77e2b911-9c19-474d-88ba-8a4ab7538884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8574ddc6-4a0d-4440-ae7a-71976353154d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:53 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Volume a03f3713-df4a-44a4-854a-52e36a2f3de8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03f3713-df4a-44a4-854a-52e36a2f3de8', 'volume_size': 1} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:53 devstack sudo[104373]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz" returned: 0 in 1.073s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:54 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c 1073741824" returned: 0 in 1.316s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:54 devstack sudo[104382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c Jun 23 04:29:54 devstack sudo[104382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:54 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz Jun 23 04:29:54 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:54 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:29:54 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:54 devstack sudo[104382]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c" returned: 0 in 0.872s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.190s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-917652987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03f3713-df4a-44a4-854a-52e36a2f3de8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481702cc01a040ccb930021f8767bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:54Z,use_quota=True,user_id='3f8e527ca8044f1a941ddf12c2bace14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Creating volume a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:29:54 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:54 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz" returned: 1 in 1.004s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_hkqlz8wz' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:29:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf2c3deb-d51c-4645-b7fa-2d57760588a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:54 devstack sudo[104390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 1073741824 Jun 23 04:29:54 devstack sudo[104390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca085d74-1aac-4db4-b99f-b4a8feb93995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a2cf2-7626-432d-90d5-8f102dc061a5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:55 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Volume volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c (405627c5-3f48-4c6c-bda1-a48f0c48b74c): created successfully Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca085d74-1aac-4db4-b99f-b4a8feb93995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Flow 'volume_create_manager' (1fa794af-731a-4693-b686-f420ab9f2a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:55 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-257b42e8-98c1-44db-a37b-d3b62d0b14c1 tempest-GroupsTest-2076988703 None] Created volume successfully. Jun 23 04:29:55 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD Jun 23 04:29:55 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:55 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.998s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:29:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:29:55 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0ec07da1-4c48-43fd-aa43-473c2112092a tempest-GroupsTest-2076988703 None] Update group completed successfully. Jun 23 04:29:56 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD" returned: 0 in 1.020s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] 930bd165-a705-4fa7-8ad1-0668e12d9b30 was qcow2, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:56 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:29:56 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:56 devstack sudo[104390]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 1073741824" returned: 0 in 1.149s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:56 devstack sudo[104415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:29:56 devstack sudo[104415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:56 devstack sudo[104415]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 0.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.964s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8574ddc6-4a0d-4440-ae7a-71976353154d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03f3713-df4a-44a4-854a-52e36a2f3de8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d30d2dd-3d5b-4524-9329-92b57985b202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:56 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Volume volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 (a03f3713-df4a-44a4-854a-52e36a2f3de8): created successfully Jun 23 04:29:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d30d2dd-3d5b-4524-9329-92b57985b202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Flow 'volume_create_manager' (40a5d75e-0e72-4cbd-abc9-84e28ae8e65b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:57 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0dc23ecf-64bc-4175-a030-dd23834f846a tempest-VolumesCloneTest-597570193 None] Created volume successfully. Jun 23 04:29:57 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c2d5b8f3-aed4-4cc6-b32a-618cfb248d4f tempest-GroupsTest-2076988703 None] Update group completed successfully. Jun 23 04:29:58 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 0 in 2.088s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_sa8hq55pdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:29:58 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Converted 112.00 MB image at 53.63 MB/s Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:58 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 1G Jun 23 04:29:58 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Flow 'volume_create_manager' (26dc21cb-fb32-4eeb-acb7-bd976952bcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fcf27c-8164-42cd-861f-9142cb37ccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fcf27c-8164-42cd-861f-9142cb37ccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:29:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1360551792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b43cebe-0195-4489-ac20-a8804fdc2e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='481702cc01a040ccb930021f8767bbe7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:29:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=a03f3713-df4a-44a4-854a-52e36a2f3de8,status='creating',terminated_at=None,updated_at=2026-06-23T02:29:58Z,use_quota=True,user_id='3f8e527ca8044f1a941ddf12c2bace14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d35e32e-d16a-4ebd-b2ca-452cd6a11f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d35e32e-d16a-4ebd-b2ca-452cd6a11f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1ffea-b1f1-48ad-88b6-b4848af84e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e1ffea-b1f1-48ad-88b6-b4848af84e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1b43cebe-0195-4489-ac20-a8804fdc2e2a', 'volume_name': 'volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a', 'volume_size': 2, 'source_volid': 'a03f3713-df4a-44a4-854a-52e36a2f3de8', 'source_volstatus': 'available'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6cd8c-88f5-4c06-ba24-a8db4e5b3735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11e6cd8c-88f5-4c06-ba24-a8db4e5b3735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fcbc2b1-9f65-42ad-a98c-4a6bb3d6b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:29:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Volume 1b43cebe-0195-4489-ac20-a8804fdc2e2a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a', 'volume_size': 2, 'source_volid': 'a03f3713-df4a-44a4-854a-52e36a2f3de8', 'source_volstatus': 'available'} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:29:58 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Cloning volume a03f3713-df4a-44a4-854a-52e36a2f3de8 to volume 1b43cebe-0195-4489-ac20-a8804fdc2e2a Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Creating offline snapshot 294ff4c8-98a8-4758-a8a6-1f8ff21784ab of volume a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d189b-36ae-4b2e-be76-cf386ad82be0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:58 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:29:58 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:58 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 1G" returned: 0 in 0.754s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e48f60c-f66e-4989-b32c-523f51fce385]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:59 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:29:59 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Acquiring lock "cinder-quobyte-405627c5-3f48-4c6c-bda1-a48f0c48b74c" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Lock "cinder-quobyte-405627c5-3f48-4c6c-bda1-a48f0c48b74c" acquired by "delete_volume" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172fd4f-867a-43d1-8d2a-5e6c4f02fae6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:59 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c Jun 23 04:29:59 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:59 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 0.809s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:59 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab 1G Jun 23 04:29:59 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:59 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 0 in 0.788s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:29:59 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:29:59 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:29:59 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c" returned: 0 in 0.803s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:29:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:00 devstack sudo[104496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c Jun 23 04:30:00 devstack sudo[104496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:00 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab 1G" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:00 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab Jun 23 04:30:00 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:00 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 1 in 0.839s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Downloaded image 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume 816cc834-079a-43d0-b6ac-2092fa737d62 successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 for user c605bd80341049a18afa46dd1c4f635c is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Marking volume 816cc834-079a-43d0-b6ac-2092fa737d62 as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Copying metadata from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 to 816cc834-079a-43d0-b6ac-2092fa737d62. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Creating volume glance metadata for volume 816cc834-079a-43d0-b6ac-2092fa737d62 backed by image 930bd165-a705-4fa7-8ad1-0668e12d9b30 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7faf909-9958-41fa-8676-136cd3943110) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-816cc834-079a-43d0-b6ac-2092fa737d62', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d121a14f-c832-46d6-926c-9202fb1cac13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Volume volume-816cc834-079a-43d0-b6ac-2092fa737d62 (816cc834-079a-43d0-b6ac-2092fa737d62): created successfully Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d121a14f-c832-46d6-926c-9202fb1cac13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (d3644eea-34f0-4b81-8d43-a0a157478a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b9c1a57e-4f81-4fb5-bbcc-5035df9c3d24 tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:30:00 devstack sudo[104496]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-405627c5-3f48-4c6c-bda1-a48f0c48b74c" returned: 0 in 0.765s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Lock "cinder-quobyte-405627c5-3f48-4c6c-bda1-a48f0c48b74c" released by "delete_volume" :: held 1.614s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Acquiring lock "cinder-quobyte-beda3619-c947-430f-adc6-ec1718784260" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Lock "cinder-quobyte-beda3619-c947-430f-adc6-ec1718784260" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f612891-149c-49b5-abeb-e2784aa0f379]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:00 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 Jun 23 04:30:00 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:00 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab" returned: 0 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:00 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab is being set with open permissions: ugo+rw Jun 23 04:30:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:00 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab Jun 23 04:30:00 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:01 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab" returned: 0 in 0.629s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:01 devstack sudo[104518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info Jun 23 04:30:01 devstack sudo[104518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:01 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260" returned: 0 in 0.843s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:01 devstack sudo[104520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260 Jun 23 04:30:01 devstack sudo[104520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (9c4568d3-3c37-4719-bb6a-00ffd2d3c7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16933cd-13d1-4d60-b4e0-9c8939be6515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c16933cd-13d1-4d60-b4e0-9c8939be6515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-983560916',display_name='tempest-VolumesGetTest-Volume-1374493883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fe8524-e0e8-4bba-9e16-8821097a2903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:02Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc273c1-7d20-465d-9be1-84fc0a9fe9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc273c1-7d20-465d-9be1-84fc0a9fe9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3158df95-a158-4be0-b707-ada3427feb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3158df95-a158-4be0-b707-ada3427feb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fe8524-e0e8-4bba-9e16-8821097a2903', 'volume_name': 'volume-d1fe8524-e0e8-4bba-9e16-8821097a2903', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f198b00c-7081-4a63-b6a7-424cf92cfa2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f198b00c-7081-4a63-b6a7-424cf92cfa2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b882fa93-1961-4c75-8170-7505bf36e717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:02 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Volume d1fe8524-e0e8-4bba-9e16-8821097a2903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fe8524-e0e8-4bba-9e16-8821097a2903', 'volume_size': 1} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:02 devstack sudo[104518]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info" returned: 0 in 0.683s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:02 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info is being set with open permissions: ugo+rw Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:02 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info Jun 23 04:30:02 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:02 devstack sudo[104520]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-beda3619-c947-430f-adc6-ec1718784260" returned: 0 in 0.671s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Lock "cinder-quobyte-beda3619-c947-430f-adc6-ec1718784260" released by "delete_volume" :: held 1.558s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Created reservations ['3ec57f73-b2e0-4cb7-a538-19aeb4667fe7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:02 devstack cinder-volume[93326]: WARNING cinder.quota [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-202757964 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-202757964, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:30:02 devstack cinder-volume[93326]: WARNING cinder.quota [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-202757964 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-202757964, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Created reservations ['4720ce87-2421-4767-8a68-6352c9f876ea', 'c1ddc427-d089-4dd7-8123-9ed7e15cc662', '12bc0cc4-0d15-40a4-8d80-1f91b0437f6f', 'd60226ba-952e-4401-becb-9b3908ae0e41'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Created reservations ['75bc44a6-7229-4a5a-a11c-3c42821a1048', '40894bd6-015d-41ba-b53f-172380bcfe5e', 'c2ca1629-71be-453c-a5ab-3391a2e8bd89', '30e87969-f9fb-4d9e-ac48-80f956e2c184'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:02 devstack sudo[104526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:02 devstack sudo[104526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:02 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.info" returned: 0 in 0.691s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Acquiring lock "cinder-quobyte-1b43cebe-0195-4489-ac20-a8804fdc2e2a" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-1b43cebe-0195-4489-ac20-a8804fdc2e2a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] snapshot: 294ff4c8-98a8-4758-a8a6-1f8ff21784ab, volume: 1b43cebe-0195-4489-ac20-a8804fdc2e2a, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a79756-6def-4009-b4fb-a480b219c993]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:03 devstack sudo[104529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab Jun 23 04:30:03 devstack sudo[104529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:03 devstack sudo[104526]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.725s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:03 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-98f340f0-5c3e-4c73-ae7a-f84b47075a16 tempest-GroupsTest-2076988703 None] Delete group completed successfully. Jun 23 04:30:03 devstack sudo[104529]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab" returned: 0 in 0.878s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03f3713-df4a-44a4-854a-52e36a2f3de8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[094f5b92-b0d3-4679-b016-c320fa4f6758]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:04 devstack sudo[104535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:30:04 devstack sudo[104535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:04 devstack sudo[104535]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 1.002s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:04 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:30:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:05 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a Jun 23 04:30:05 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:10 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a" returned: 0 in 5.783s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbae2d6a-303c-45e9-be0b-67e0544a4e46]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:10 devstack sudo[104570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:30:10 devstack sudo[104570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:10 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-610c1d61-addb-477f-ac6d-e4849cadd1d8 tempest-GroupsV314Test-1822362177 None] Group tempest-GroupsV314Test-Group-1099507549: creating Jun 23 04:30:10 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-610c1d61-addb-477f-ac6d-e4849cadd1d8 tempest-GroupsV314Test-1822362177 None] Group tempest-GroupsV314Test-Group-1099507549: created successfully Jun 23 04:30:10 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-610c1d61-addb-477f-ac6d-e4849cadd1d8 tempest-GroupsV314Test-1822362177 None] Create group completed successfully. Jun 23 04:30:11 devstack sudo[104570]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 0.959s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:11 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8, size 1024.00 MB, duration 5.78 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:30:11 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Converted 1024.00 MB image at 177.02 MB/s Jun 23 04:30:11 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a is being set with open permissions: ugo+rw Jun 23 04:30:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:11 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a Jun 23 04:30:11 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:12 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a" returned: 0 in 0.637s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-1b43cebe-0195-4489-ac20-a8804fdc2e2a" released by "_copy_volume_from_snapshot" :: held 9.399s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Acquiring lock "cinder-quobyte-294ff4c8-98a8-4758-a8a6-1f8ff21784ab" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-294ff4c8-98a8-4758-a8a6-1f8ff21784ab" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Deleting offline snapshot 294ff4c8-98a8-4758-a8a6-1f8ff21784ab of volume a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] snapshot_file for this snap is: volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f36dbce-d853-4e08-93e2-803f4fb0a0c9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Flow 'volume_create_manager' (2201e9c7-0f45-4b65-bd3b-e0a7ff972a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca23ec8-e01b-454d-8d2b-7dd59232d274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:12 devstack sudo[104578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab Jun 23 04:30:12 devstack sudo[104578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eca23ec8-e01b-454d-8d2b-7dd59232d274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161977283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfe1287-43d0-42df-b0ab-4189b9dcaf3c,host='devstack@QuobyteHD#QuobyteHD',id=82e845e3-3692-46fc-893e-2655ac094577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a56c1470948430784c92c3c513ea94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:13Z,use_quota=True,user_id='09674ecc6b73450cb00c5325626cf631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e933cf6b-c78e-4290-b080-382ac3b30123),volume_type_id=e933cf6b-c78e-4290-b080-382ac3b30123)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576f1091-21dc-460a-9ae7-b15c35c83ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576f1091-21dc-460a-9ae7-b15c35c83ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0500ec59-32eb-4dec-b6bd-dd35daa4dba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0500ec59-32eb-4dec-b6bd-dd35daa4dba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e845e3-3692-46fc-893e-2655ac094577', 'volume_name': 'volume-82e845e3-3692-46fc-893e-2655ac094577', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5208c17f-57fc-4682-8e67-7c2359f909a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5208c17f-57fc-4682-8e67-7c2359f909a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05137b7-0afa-4249-a458-0b0073850ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:12 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Volume 82e845e3-3692-46fc-893e-2655ac094577: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e845e3-3692-46fc-893e-2655ac094577', 'volume_size': 1} Jun 23 04:30:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:13 devstack sudo[104578]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab" returned: 0 in 0.837s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03f3713-df4a-44a4-854a-52e36a2f3de8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:30:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5b4393-7e3c-4af0-8a45-81bcc9be8f61]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:13 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:30:13 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:14 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 0.769s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:14 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab Jun 23 04:30:14 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:14 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab" returned: 0 in 0.743s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:14 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab Jun 23 04:30:14 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:15 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8.294ff4c8-98a8-4758-a8a6-1f8ff21784ab" returned: 0 in 0.665s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-294ff4c8-98a8-4758-a8a6-1f8ff21784ab" released by "_delete_snapshot" :: held 3.124s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.032s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.407s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-983560916',display_name='tempest-VolumesGetTest-Volume-1374493883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fe8524-e0e8-4bba-9e16-8821097a2903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eed8f2db77be4992b4bc778aeb045a71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:02Z,use_quota=True,user_id='c605bd80341049a18afa46dd1c4f635c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Creating volume d1fe8524-e0e8-4bba-9e16-8821097a2903 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:15 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fcbc2b1-9f65-42ad-a98c-4a6bb3d6b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a', 'volume_size': 2, 'source_volid': 'a03f3713-df4a-44a4-854a-52e36a2f3de8', 'source_volstatus': 'available'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:15 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 1073741824 Jun 23 04:30:15 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f49c5-a70c-46eb-a942-ba206dbbd77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Volume volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a (1b43cebe-0195-4489-ac20-a8804fdc2e2a): created successfully Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f49c5-a70c-46eb-a942-ba206dbbd77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Flow 'volume_create_manager' (26dc21cb-fb32-4eeb-acb7-bd976952bcfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-92bbb0b9-0f6e-4b2e-9166-5750e507dc91 tempest-VolumesCloneTest-597570193 None] Created volume successfully. Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Acquiring lock "cinder-1b43cebe-0195-4489-ac20-a8804fdc2e2a-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Lock "cinder-1b43cebe-0195-4489-ac20-a8804fdc2e2a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:16 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 1073741824" returned: 0 in 0.840s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Acquiring lock "cinder-quobyte-1b43cebe-0195-4489-ac20-a8804fdc2e2a" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-1b43cebe-0195-4489-ac20-a8804fdc2e2a" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:16 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 Jun 23 04:30:16 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0185102-0953-4a4c-9a24-b0f4229ac045]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:16 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a Jun 23 04:30:16 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:17 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903" returned: 0 in 0.629s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.301s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b882fa93-1961-4c75-8170-7505bf36e717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fe8524-e0e8-4bba-9e16-8821097a2903', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78ce4eb-829b-49ef-84ac-9e18698a67ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19af0c8-3616-4806-880f-84bd95c57357]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Volume volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 (d1fe8524-e0e8-4bba-9e16-8821097a2903): created successfully Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78ce4eb-829b-49ef-84ac-9e18698a67ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Flow 'volume_create_manager' (9c4568d3-3c37-4719-bb6a-00ffd2d3c7c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cfbd7b83-31ff-4ab8-aa0d-d95c83985e0e tempest-VolumesGetTest-2000948514 None] Created volume successfully. Jun 23 04:30:17 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:30:17 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:17 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a" returned: 0 in 0.797s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:17 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a Jun 23 04:30:17 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:18 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 0.852s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.876s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.326s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3bfe1287-43d0-42df-b0ab-4189b9dcaf3c,created_at=2026-06-23T02:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-161977283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3bfe1287-43d0-42df-b0ab-4189b9dcaf3c,host='devstack@QuobyteHD#QuobyteHD',id=82e845e3-3692-46fc-893e-2655ac094577,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a56c1470948430784c92c3c513ea94c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:13Z,use_quota=True,user_id='09674ecc6b73450cb00c5325626cf631',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e933cf6b-c78e-4290-b080-382ac3b30123),volume_type_id=e933cf6b-c78e-4290-b080-382ac3b30123)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Creating volume 82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:18 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:18 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1b43cebe-0195-4489-ac20-a8804fdc2e2a" returned: 0 in 0.692s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:18 devstack sudo[104618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 1073741824 Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-1b43cebe-0195-4489-ac20-a8804fdc2e2a" released by "delete_volume" :: held 1.536s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:18 devstack sudo[104618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-d1fe8524-e0e8-4bba-9e16-8821097a2903-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-094417c0-dc82-4d4b-89a2-d1f52a701cec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '625b254c-72c2-4c12-a4bc-c45c6f8af362', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Lock "cinder-d1fe8524-e0e8-4bba-9e16-8821097a2903-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Created reservations ['83eb0487-2475-4b53-ae29-7cf92cb36186', '2f815841-e554-42ff-a35d-41bf307a5f05', '0b6b981f-678b-4d01-a1e4-e20f71de140c', '9b1a7fb9-66fd-4ed0-8e2e-f3321acf0330'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-d1fe8524-e0e8-4bba-9e16-8821097a2903" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-d1fe8524-e0e8-4bba-9e16-8821097a2903" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-5a419d53-afb4-40ee-99d2-cfc355f5fea4 req-4d25f610-26fe-41a5-9827-19e635a011c2 tempest-TestStampPattern-717296437 None] attachment_update completed successfully. Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eb9f72-6178-42df-92d1-b119c9713057]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:18 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:18 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:18 devstack sudo[104624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 Jun 23 04:30:18 devstack sudo[104624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Acquiring lock "cinder-a03f3713-df4a-44a4-854a-52e36a2f3de8-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Lock "cinder-a03f3713-df4a-44a4-854a-52e36a2f3de8-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Acquiring lock "cinder-quobyte-a03f3713-df4a-44a4-854a-52e36a2f3de8" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-a03f3713-df4a-44a4-854a-52e36a2f3de8" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2526521a-0372-4e17-8327-b85912a79df7]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:19 devstack sudo[104699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:30:19 devstack sudo[104699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:19 devstack sudo[104618]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 1073741824" returned: 0 in 1.100s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:19 devstack sudo[104624]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903" returned: 0 in 0.956s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:19 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:19 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:19 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903 Jun 23 04:30:19 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:19 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.065s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Deleted volume successfully. Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-16593625-fee4-4c4e-bf24-00c2f66961b7 tempest-VolumesCloneTest-597570193 None] Lock "cinder-1b43cebe-0195-4489-ac20-a8804fdc2e2a-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:19 devstack sudo[104699]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 1.012s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:19 devstack sudo[105032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8 Jun 23 04:30:19 devstack sudo[105032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:20 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 0.831s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.986s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e05137b7-0afa-4249-a458-0b0073850ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e845e3-3692-46fc-893e-2655ac094577', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026338c2-0d46-4643-ad98-85def2d94f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:20 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:20 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Volume volume-82e845e3-3692-46fc-893e-2655ac094577 (82e845e3-3692-46fc-893e-2655ac094577): created successfully Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (026338c2-0d46-4643-ad98-85def2d94f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Flow 'volume_create_manager' (2201e9c7-0f45-4b65-bd3b-e0a7ff972a1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d1fe8524-e0e8-4bba-9e16-8821097a2903" returned: 0 in 0.848s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2016d016-fc81-499c-90f3-e7f3d06e0bbc tempest-GroupsV314Test-1822362177 None] Created volume successfully. Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-d1fe8524-e0e8-4bba-9e16-8821097a2903" released by "delete_volume" :: held 1.864s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Created reservations ['348215e1-ca2e-4f47-a910-35bc715282eb', 'cd063bd8-fd9c-4609-9976-a9c8f0bd5ebb', 'c6d93dbb-0cc3-43d6-9209-adca882db5c2', '7b15364b-0606-4337-8d22-bfe639fbcc05'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:20 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:20 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-816cc834-079a-43d0-b6ac-2092fa737d62-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Lock "cinder-816cc834-079a-43d0-b6ac-2092fa737d62-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Acquiring lock "cinder-quobyte-816cc834-079a-43d0-b6ac-2092fa737d62" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-816cc834-079a-43d0-b6ac-2092fa737d62" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c7ab56-bdfc-4916-a280-2bc5a720db25]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:20 devstack sudo[105032]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a03f3713-df4a-44a4-854a-52e36a2f3de8" returned: 0 in 0.701s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Lock "cinder-quobyte-a03f3713-df4a-44a4-854a-52e36a2f3de8" released by "delete_volume" :: held 1.774s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Created reservations ['94289a0f-2ea6-45a2-a15c-3669e69cc17c', '1eb1ca77-1cc5-45f6-853d-c851d6b684ec', '637f7cef-f158-4ad5-99c7-a8538037014c', '0f6617d9-81b4-43ac-a997-ede9d0f85122'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:20 devstack sudo[105037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:30:20 devstack sudo[105037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:20 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:20 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:20 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.743s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:20 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:30:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1f25c8d7-afbd-4e96-bcf2-e0e2ac72a8ce tempest-VolumesGetTest-2000948514 None] Lock "cinder-d1fe8524-e0e8-4bba-9e16-8821097a2903-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:21 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.799s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:21 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:21 devstack sudo[105037]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 0 in 0.998s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:21 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Deleted volume successfully. Jun 23 04:30:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-d9ad8d0d-ca2b-4bd9-955e-944d30f88a84 tempest-VolumesCloneTest-597570193 None] Lock "cinder-a03f3713-df4a-44a4-854a-52e36a2f3de8-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:21 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:30:21 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=120,cinder:UPDATE=160,cinder:DELETE=11,cinder:INSERT=36 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=121,cinder:UPDATE=133,cinder:INSERT=39,cinder:DELETE=10 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:22 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Cloning volume 82e845e3-3692-46fc-893e-2655ac094577 to volume da14194c-7eda-4868-a17b-2bca40860584 Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Creating offline snapshot a431a4ee-5dc0-4f91-9853-44e874ae5247 of volume 82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[83081974-8b86-4f1d-9660-5e3fd16ffe7e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:22 devstack sudo[105047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:22 devstack sudo[105047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:22 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 1 in 1.108s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:30:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:22 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62 Jun 23 04:30:22 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:23 devstack sudo[105047]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 1.055s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:23 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 1G Jun 23 04:30:23 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:23 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-816cc834-079a-43d0-b6ac-2092fa737d62" returned: 0 in 0.824s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Lock "cinder-quobyte-816cc834-079a-43d0-b6ac-2092fa737d62" released by "delete_volume" :: held 3.004s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Created reservations ['2e3e3f82-66ba-4a26-94dc-ab64b016ad01', '57fef93b-4dbb-4660-909b-ce2fe327e1ea', 'c3d1a23f-0371-45f1-947f-7df7184670f9', '4d9f6cf7-a1a5-4d8b-9009-95d5ee723c77'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:23 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:23 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:24 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 1G" returned: 0 in 1.208s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e845e3-3692-46fc-893e-2655ac094577 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:24 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e845e3-3692-46fc-893e-2655ac094577 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 Jun 23 04:30:24 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:24 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.093s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:24 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Deleted volume successfully. Jun 23 04:30:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-63e2832b-92d6-4885-a97f-91be0f093a01 tempest-VolumesGetTest-2000948514 None] Lock "cinder-816cc834-079a-43d0-b6ac-2092fa737d62-delete_volume" released by "delete_volume" :: held 4.448s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:25 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82e845e3-3692-46fc-893e-2655ac094577 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247" returned: 0 in 1.100s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:25 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:30:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:25 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 Jun 23 04:30:25 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Flow 'volume_create_manager' (e425d901-204e-464c-8d16-6fc50b50ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e26369-c109-4016-8871-ca3071110df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14e26369-c109-4016-8871-ca3071110df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-249790706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db311ac0-0ef5-4c39-a1ca-6d428151c8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8adcbde1ac447daf00fca65aac0880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:26Z,use_quota=True,user_id='fd259df34a524a3fa66c93279bb91848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdb590c-69e3-4d76-93bc-20317869686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffdb590c-69e3-4d76-93bc-20317869686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cec12a0-d959-48ee-9916-018efa0713a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cec12a0-d959-48ee-9916-018efa0713a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db311ac0-0ef5-4c39-a1ca-6d428151c8f7', 'volume_name': 'volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de052e68-277b-4cd3-9516-b6097fed1ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de052e68-277b-4cd3-9516-b6097fed1ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b591de1-75c8-4003-94ae-f8ba2d1c5f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:26 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Volume db311ac0-0ef5-4c39-a1ca-6d428151c8f7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Trying to clone db311ac0-0ef5-4c39-a1ca-6d428151c8f7 from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:30:26 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247" returned: 0 in 0.997s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:26 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info Jun 23 04:30:26 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:30:26 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Image download 20.69 MB at 20.69 MB/s Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d684ac-2238-49fa-9429-f3a6f671932d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:27 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD Jun 23 04:30:27 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:27 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info" returned: 0 in 0.794s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:27 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:30:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:27 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info Jun 23 04:30:27 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:27 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD" returned: 0 in 0.836s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:27 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 is fetched for user fd259df34a524a3fa66c93279bb91848. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:30:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c4fa70-3803-4e9f-9842-7f5bd66fb898]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:28 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD Jun 23 04:30:28 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-b4d0737a-025c-4b70-95a5-3ae3794c134b req-5341c3ea-6fcf-4971-8ff0-f38659634787 tempest-TestStampPattern-717296437 None] Terminate volume connection completed successfully. Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-b4d0737a-025c-4b70-95a5-3ae3794c134b req-5341c3ea-6fcf-4971-8ff0-f38659634787 tempest-TestStampPattern-717296437 None] Deleting attachment 625b254c-72c2-4c12-a4bc-c45c6f8af362. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:30:28 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.info" returned: 0 in 0.889s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Acquiring lock "cinder-quobyte-da14194c-7eda-4868-a17b-2bca40860584" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-da14194c-7eda-4868-a17b-2bca40860584" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] snapshot: a431a4ee-5dc0-4f91-9853-44e874ae5247, volume: da14194c-7eda-4868-a17b-2bca40860584, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5fbddf-4e4e-47ce-88c0-24ed04dd5b89]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Flow 'volume_create_manager' (500cd839-c767-4f6c-b734-c36151159926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5803a9ac-2310-4961-87b3-f4fea961ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5803a9ac-2310-4961-87b3-f4fea961ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1516150289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966ae9a3-53cd-4021-868e-3133bc03fb1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f12ed805d7f1426db958f158db36daee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:28Z,use_quota=True,user_id='09a06addbb8b41e498d9eff0caf8ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:28 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 Jun 23 04:30:28 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f07a622-f43d-4f57-a175-5747ec9876a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f07a622-f43d-4f57-a175-5747ec9876a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b097900e-e8ba-4322-aa6d-930278a84460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b097900e-e8ba-4322-aa6d-930278a84460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '966ae9a3-53cd-4021-868e-3133bc03fb1f', 'volume_name': 'volume-966ae9a3-53cd-4021-868e-3133bc03fb1f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0fc195-60a1-4f87-b560-91a96ae39562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a0fc195-60a1-4f87-b560-91a96ae39562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e04a5e7-1867-4ee7-a445-4069c7f16f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:28 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Volume 966ae9a3-53cd-4021-868e-3133bc03fb1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-966ae9a3-53cd-4021-868e-3133bc03fb1f', 'volume_size': 1} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:28 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD" returned: 0 in 0.907s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:29 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247" returned: 0 in 0.802s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e845e3-3692-46fc-893e-2655ac094577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:30:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:30:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:30:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51123d94-31c5-4096-a27e-4cf2aae1b1c3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:29 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:29 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:30 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 0.857s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:30 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:30:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:30 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 Jun 23 04:30:30 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:34 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584" returned: 0 in 4.608s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:34 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a723bf06-668c-4987-bb8d-72a42ecdc111]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:34 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:34 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:35 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 0.973s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:35 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577, size 1024.00 MB, duration 4.61 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:30:35 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Converted 1024.00 MB image at 222.18 MB/s Jun 23 04:30:35 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 is being set with open permissions: ugo+rw: NotImplementedError Jun 23 04:30:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:35 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 Jun 23 04:30:35 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:36 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584" returned: 0 in 0.644s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-da14194c-7eda-4868-a17b-2bca40860584" released by "_copy_volume_from_snapshot" :: held 7.975s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Acquiring lock "cinder-quobyte-a431a4ee-5dc0-4f91-9853-44e874ae5247" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-a431a4ee-5dc0-4f91-9853-44e874ae5247" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Deleting offline snapshot a431a4ee-5dc0-4f91-9853-44e874ae5247 of volume 82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] snapshot_file for this snap is: volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceda05b-02c1-441e-aa87-39c55bd1f5e3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:36 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 Jun 23 04:30:36 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:37 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247" returned: 0 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82e845e3-3692-46fc-893e-2655ac094577(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:30:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1f65ed-57e0-4a41-89d0-9c5245d8f1d5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:37 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:37 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:37 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:37 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 Jun 23 04:30:37 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:38 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247" returned: 0 in 0.742s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:38 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247 Jun 23 04:30:38 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:39 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577.a431a4ee-5dc0-4f91-9853-44e874ae5247" returned: 0 in 0.632s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-a431a4ee-5dc0-4f91-9853-44e874ae5247" released by "_delete_snapshot" :: held 2.945s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.200s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.771s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1516150289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=966ae9a3-53cd-4021-868e-3133bc03fb1f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f12ed805d7f1426db958f158db36daee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:28Z,use_quota=True,user_id='09a06addbb8b41e498d9eff0caf8ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Creating volume 966ae9a3-53cd-4021-868e-3133bc03fb1f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:39 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:39 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f 1073741824 Jun 23 04:30:39 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:39 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-72f8b682-3caa-4d21-bc1b-fd5dad52b545 tempest-GroupsV314Test-1822362177 None] Create group from source-group-3bfe1287-43d0-42df-b0ab-4189b9dcaf3c completed successfully. Jun 23 04:30:40 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f 1073741824" returned: 0 in 0.828s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:40 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f Jun 23 04:30:40 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Acquiring lock "cinder-quobyte-da14194c-7eda-4868-a17b-2bca40860584" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-da14194c-7eda-4868-a17b-2bca40860584" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b9ff38-1765-4bc0-b6d2-c94e78ccf736]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:40 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 Jun 23 04:30:40 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:40 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f" returned: 0 in 0.675s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.151s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-249790706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db311ac0-0ef5-4c39-a1ca-6d428151c8f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8adcbde1ac447daf00fca65aac0880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:26Z,use_quota=True,user_id='fd259df34a524a3fa66c93279bb91848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Creating volume db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:40 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:40 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 1073741824 Jun 23 04:30:40 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e04a5e7-1867-4ee7-a445-4069c7f16f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-966ae9a3-53cd-4021-868e-3133bc03fb1f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ce3fe4-9f47-4dde-9951-7ead401bdba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:40 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Volume volume-966ae9a3-53cd-4021-868e-3133bc03fb1f (966ae9a3-53cd-4021-868e-3133bc03fb1f): created successfully Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ce3fe4-9f47-4dde-9951-7ead401bdba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Flow 'volume_create_manager' (500cd839-c767-4f6c-b734-c36151159926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4439ffe0-f675-43ba-a0ca-a2a35b1e51ee tempest-VolumesListTestJSON-1043136844 None] Created volume successfully. Jun 23 04:30:41 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584" returned: 0 in 0.799s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:41 devstack sudo[105227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584 Jun 23 04:30:41 devstack sudo[105227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:41 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 1073741824" returned: 0 in 0.905s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:41 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:41 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:41 devstack sudo[105227]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da14194c-7eda-4868-a17b-2bca40860584" returned: 0 in 0.777s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-da14194c-7eda-4868-a17b-2bca40860584" released by "delete_volume" :: held 1.623s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Flow 'volume_create_manager' (f23f3d90-e874-4f61-9ca8-f65f3a0efba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72761956-6d66-4a33-95ca-e5d5736f2bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72761956-6d66-4a33-95ca-e5d5736f2bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1856665132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadb99ea-d7fc-42b4-9d10-77d7724d62f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f12ed805d7f1426db958f158db36daee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:42Z,use_quota=True,user_id='09a06addbb8b41e498d9eff0caf8ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf819d3-97e5-4808-9532-e442449d0cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bf819d3-97e5-4808-9532-e442449d0cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f10e31-cc10-4f4f-a4fe-c78c3fc1122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f10e31-cc10-4f4f-a4fe-c78c3fc1122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eadb99ea-d7fc-42b4-9d10-77d7724d62f8', 'volume_name': 'volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2ca58f-f0bb-4bae-8b29-e3d399c5cc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2ca58f-f0bb-4bae-8b29-e3d399c5cc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baef8b1-35e2-41b7-a368-58e48dfacdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:42 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Volume eadb99ea-d7fc-42b4-9d10-77d7724d62f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8', 'volume_size': 1} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Created reservations ['2359dc20-c425-479f-90fc-5223affb7848'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1824008268 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1824008268, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:30:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1824008268 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1824008268, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Created reservations ['14f668e0-a56e-49cd-aedd-395b588bf329', '19ef31f2-e0ea-43d5-8aea-3bb95a2f43ec', 'ff1e0f9e-f863-4d2d-aa8c-ca0dac8111f5', '8e3fc28b-944f-41b8-bbac-add1d657f151'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:42 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:42 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:42 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 0 in 0.672s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.437s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Creating offline snapshot 2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 of volume 094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Attempting download of 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume db311ac0-0ef5-4c39-a1ca-6d428151c8f7. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4700a5eb-fa20-4648-9470-7896470b1809]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c52ddf0-ea1d-4bf7-b3a4-caa3b2c0ae9e]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:42 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:30:42 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:42 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud Jun 23 04:30:42 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:43 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.817s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1b9cacdb-456b-4c38-9cde-acd514496ecf tempest-GroupsV314Test-1822362177 None] Delete group completed successfully. Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Acquiring lock "cinder-quobyte-82e845e3-3692-46fc-893e-2655ac094577" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-82e845e3-3692-46fc-893e-2655ac094577" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74053089-1bea-481c-ba55-685e9efd26b9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:43 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:43 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:43 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 0.848s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:43 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 1G Jun 23 04:30:43 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:43 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud" returned: 0 in 0.826s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:43 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud Jun 23 04:30:43 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:44 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 0.814s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:44 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577 Jun 23 04:30:44 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:44 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud" returned: 1 in 0.707s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_3gnxuuud' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[74238cd1-3126-4194-8197-f7de7919f52c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:44 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 1G" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094417c0-dc82-4d4b-89a2-d1f52a701cec -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:44 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD Jun 23 04:30:44 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:44 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094417c0-dc82-4d4b-89a2-d1f52a701cec -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 Jun 23 04:30:44 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:44 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-82e845e3-3692-46fc-893e-2655ac094577" returned: 0 in 0.691s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Lock "cinder-quobyte-82e845e3-3692-46fc-893e-2655ac094577" released by "delete_volume" :: held 1.585s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Created reservations ['d26b62ea-ae9c-4b92-8020-dec90d02850b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Created reservations ['a24cb4bf-8a92-456f-b1cb-2b5f8ee839f8', 'af687550-e95e-42fe-bc9f-7c9effdb4b12', '0189b6c5-9b97-458d-8a85-59c103be5e10', '397b708f-6967-43ac-b3a4-3452911774a0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:44 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:44 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] 930bd165-a705-4fa7-8ad1-0668e12d9b30 was qcow2, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:45 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:45 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:45 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-094417c0-dc82-4d4b-89a2-d1f52a701cec -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" returned: 0 in 0.769s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:45 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 is being set with open permissions: ugo+rw Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:45 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:45 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:45 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 Jun 23 04:30:45 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:45 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" returned: 0 in 0.752s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:45 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.780s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:45 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-fb999b65-4bdb-44bc-8be5-6f0a148cd3f7 tempest-GroupsV314Test-1822362177 None] Delete group completed successfully. Jun 23 04:30:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:45 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info Jun 23 04:30:45 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:46 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info" returned: 0 in 0.739s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:46 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info is being set with open permissions: ugo+rw Jun 23 04:30:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:46 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info Jun 23 04:30:46 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:47 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 0 in 2.185s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_6us3lvkfdevstack@QuobyteHD, size 112.00 MB, duration 2.19 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:30:47 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Converted 112.00 MB image at 51.23 MB/s Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:47 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 1G Jun 23 04:30:47 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:47 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.info" returned: 0 in 0.719s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.798s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.255s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1856665132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eadb99ea-d7fc-42b4-9d10-77d7724d62f8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f12ed805d7f1426db958f158db36daee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:42Z,use_quota=True,user_id='09a06addbb8b41e498d9eff0caf8ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Creating volume eadb99ea-d7fc-42b4-9d10-77d7724d62f8 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:47 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:47 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 1073741824 Jun 23 04:30:47 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:47 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f741269b-dd2c-46f0-bc55-6e3fd0d464d3 tempest-TestStampPattern-717296437 None] Create snapshot completed successfully Jun 23 04:30:47 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 1G" returned: 0 in 0.782s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12490e7d-2f9e-4533-aeb1-8a73dc075227]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:48 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:48 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:48 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 1073741824" returned: 0 in 1.004s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:48 devstack sudo[105324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 Jun 23 04:30:48 devstack sudo[105324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:48 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 0 in 0.906s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:49 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:49 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:49 devstack sudo[105324]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8" returned: 0 in 0.891s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0baef8b1-35e2-41b7-a368-58e48dfacdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e20ed6-61c8-4bc1-9962-b251ef6d9d50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Volume volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 (eadb99ea-d7fc-42b4-9d10-77d7724d62f8): created successfully Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e20ed6-61c8-4bc1-9962-b251ef6d9d50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Flow 'volume_create_manager' (f23f3d90-e874-4f61-9ca8-f65f3a0efba7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:49 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c5be7ee8-199d-4453-b499-cf773c5f3f35 tempest-VolumesListTestJSON-1043136844 None] Created volume successfully. Jun 23 04:30:49 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 1 in 0.867s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Downloaded image 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume db311ac0-0ef5-4c39-a1ca-6d428151c8f7 successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 for user fd259df34a524a3fa66c93279bb91848 is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Marking volume db311ac0-0ef5-4c39-a1ca-6d428151c8f7 as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Copying metadata from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 to db311ac0-0ef5-4c39-a1ca-6d428151c8f7. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Creating volume glance metadata for volume db311ac0-0ef5-4c39-a1ca-6d428151c8f7 backed by image 930bd165-a705-4fa7-8ad1-0668e12d9b30 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b591de1-75c8-4003-94ae-f8ba2d1c5f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e4afa7-7ec7-426f-91d2-fa5922d46b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Volume volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 (db311ac0-0ef5-4c39-a1ca-6d428151c8f7): created successfully Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89e4afa7-7ec7-426f-91d2-fa5922d46b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Flow 'volume_create_manager' (e425d901-204e-464c-8d16-6fc50b50ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:49 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-233ee7ff-7d4f-4d61-9569-6e7863fa7459 tempest-VolumesExtendTest-1839673539 None] Created volume successfully. Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Flow 'volume_create_manager' (2029b47b-3ec2-4e9e-82ba-3efbe6d1afb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cdf440-f62b-4dae-9bfa-e0afae4e34ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f1934e-6a35-4d8f-8ffb-7713bbdc28da]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cdf440-f62b-4dae-9bfa-e0afae4e34ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-805708379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b123fede-3acf-4e45-9d07-8262d151f291,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f12ed805d7f1426db958f158db36daee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:51Z,use_quota=True,user_id='09a06addbb8b41e498d9eff0caf8ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7769a452-48c8-4d51-b5c6-ceda7580dea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7769a452-48c8-4d51-b5c6-ceda7580dea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff5b233-fd3c-4611-8a37-49aad86f87bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ff5b233-fd3c-4611-8a37-49aad86f87bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b123fede-3acf-4e45-9d07-8262d151f291', 'volume_name': 'volume-b123fede-3acf-4e45-9d07-8262d151f291', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e26ab43-2b18-44a3-8985-9cb8d86bbfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e26ab43-2b18-44a3-8985-9cb8d86bbfa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba34af8a-5fc8-42f7-ba95-984a0c15c1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Volume b123fede-3acf-4e45-9d07-8262d151f291: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b123fede-3acf-4e45-9d07-8262d151f291', 'volume_size': 1} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:51 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:51 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6a35973-3680-4f21-9aba-ce57e2cd0c1b tempest-GroupsV320Test-1478047877 None] Group tempest-GroupsV320Test-Group-1040598163: creating Jun 23 04:30:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6a35973-3680-4f21-9aba-ce57e2cd0c1b tempest-GroupsV320Test-1478047877 None] Group tempest-GroupsV320Test-Group-1040598163: created successfully Jun 23 04:30:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6a35973-3680-4f21-9aba-ce57e2cd0c1b tempest-GroupsV320Test-1478047877 None] Create group completed successfully. Jun 23 04:30:51 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 0 in 0.769s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:52 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:52 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:52 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 1 in 0.802s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 2G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 2G" returned: 0 in 0.079s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.709s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.607s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-805708379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b123fede-3acf-4e45-9d07-8262d151f291,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f12ed805d7f1426db958f158db36daee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:51Z,use_quota=True,user_id='09a06addbb8b41e498d9eff0caf8ad51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Creating volume b123fede-3acf-4e45-9d07-8262d151f291 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:52 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:52 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 1073741824 Jun 23 04:30:52 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d84d1706-ba42-4713-984a-c92e4095a1e9 tempest-VolumesExtendTest-1839673539 None] Extend volume completed successfully. Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Created reservations ['4aa92077-1446-4932-bbb2-156b4e2e5cf0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:53 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:53 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-db311ac0-0ef5-4c39-a1ca-6d428151c8f7-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-db311ac0-0ef5-4c39-a1ca-6d428151c8f7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-quobyte-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf5c54e-f095-46b2-869d-24711e9e971c]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:53 devstack sudo[105390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:53 devstack sudo[105390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:53 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.722s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:53 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:53 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-44177209-ec69-4ebd-a716-1b785fbb63cc tempest-GroupsV320Test-1478047877 None] Delete group completed successfully. Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 1073741824" returned: 0 in 1.014s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:53 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 Jun 23 04:30:53 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:54 devstack sudo[105390]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 0 in 0.866s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:54 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291" returned: 0 in 0.756s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:54 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:54 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba34af8a-5fc8-42f7-ba95-984a0c15c1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b123fede-3acf-4e45-9d07-8262d151f291', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cf3238-7ddb-4067-ad41-08485c829ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:54 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Volume volume-b123fede-3acf-4e45-9d07-8262d151f291 (b123fede-3acf-4e45-9d07-8262d151f291): created successfully Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cf3238-7ddb-4067-ad41-08485c829ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Flow 'volume_create_manager' (2029b47b-3ec2-4e9e-82ba-3efbe6d1afb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:54 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:54 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9200ac95-46ea-4e8a-aae0-8d8d4e99cad5 tempest-VolumesListTestJSON-1043136844 None] Created volume successfully. Jun 23 04:30:55 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:30:55 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 1 in 0.908s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:30:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:55 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7 Jun 23 04:30:55 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:56 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" returned: 0 in 0.911s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-db311ac0-0ef5-4c39-a1ca-6d428151c8f7" released by "delete_volume" :: held 2.762s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Created reservations ['3359dd26-1ea5-4d7b-b6d1-e8005ec08c58', '785a7703-b734-482f-8c6a-cf74f8ee3f62', '11e55642-025f-446f-843b-0933136e6efa', '8f62bbce-5840-48f6-864f-9245b9eb93b9'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:56 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:30:56 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Flow 'volume_create_manager' (d3d49fda-641d-474b-9466-1e4692d4288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e99c88-58cc-44d6-b9ef-31f515dc791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:58 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.425s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e99c88-58cc-44d6-b9ef-31f515dc791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-16645965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8adcbde1ac447daf00fca65aac0880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:58Z,use_quota=True,user_id='fd259df34a524a3fa66c93279bb91848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d07d29-7bd8-43d6-809c-6f0ae72ec10d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d07d29-7bd8-43d6-809c-6f0ae72ec10d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c81cf0-bc53-4125-ba32-83e24b689d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98c81cf0-bc53-4125-ba32-83e24b689d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865', 'volume_name': 'volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54439de-4a48-4db3-af9a-e02463c84f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d54439de-4a48-4db3-af9a-e02463c84f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef24925-59c6-4031-bda6-766010b96209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:30:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Volume 0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865', 'volume_size': 1} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:30:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-16645965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c8adcbde1ac447daf00fca65aac0880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:30:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:30:58Z,use_quota=True,user_id='fd259df34a524a3fa66c93279bb91848',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Creating volume 0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:30:58 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:58 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Deleted volume successfully. Jun 23 04:30:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-12470e6b-b724-478f-ad3f-b2083810c8aa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-db311ac0-0ef5-4c39-a1ca-6d428151c8f7-delete_volume" released by "delete_volume" :: held 4.736s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:30:58 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 1073741824 Jun 23 04:30:58 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "cinder-b123fede-3acf-4e45-9d07-8262d151f291-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-b123fede-3acf-4e45-9d07-8262d151f291-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "cinder-quobyte-b123fede-3acf-4e45-9d07-8262d151f291" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-quobyte-b123fede-3acf-4e45-9d07-8262d151f291" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cc488a-d524-4fc1-a87c-dce89e0248cf]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:59 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 Jun 23 04:30:59 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:30:59 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 1073741824" returned: 0 in 1.204s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:30:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:30:59 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 Jun 23 04:30:59 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:00 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291" returned: 0 in 0.876s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:00 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" returned: 0 in 0.717s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:00 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291 Jun 23 04:31:00 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aef24925-59c6-4031-bda6-766010b96209) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f094fcf4-46e7-4b64-b634-227ca25a9776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Volume volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 (0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865): created successfully Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f094fcf4-46e7-4b64-b634-227ca25a9776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Flow 'volume_create_manager' (d3d49fda-641d-474b-9466-1e4692d4288c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c789581a-4544-4bfd-8262-fadab548aaad tempest-VolumesExtendTest-1839673539 None] Created volume successfully. Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Flow 'volume_create_manager' (6286771c-7b52-496c-9200-8d8f626091a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7623fb-39ea-4556-beca-d31dde06c062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7623fb-39ea-4556-beca-d31dde06c062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1954632872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb8f5a987ee46a1b608d7022c133680',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2587ed99-81f3-4bfa-bbde-61fb8f2e10c7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:31:01Z,use_quota=True,user_id='b2a2a26ef74245f3be9b3d44bb8787a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49313197-8626-4030-b72e-853f084d5a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49313197-8626-4030-b72e-853f084d5a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219bdd73-f62f-461d-85db-b3e943304d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219bdd73-f62f-461d-85db-b3e943304d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f', 'volume_name': 'volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f', 'volume_size': 1, 'snapshot_id': '2587ed99-81f3-4bfa-bbde-61fb8f2e10c7'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75b6f86-f359-47e6-9e99-d976786bca15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b75b6f86-f359-47e6-9e99-d976786bca15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615729cb-88b2-47dd-abd3-1156a004748d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Volume cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f', 'volume_size': 1, 'snapshot_id': '2587ed99-81f3-4bfa-bbde-61fb8f2e10c7'} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-quobyte-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Creating volume cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f from snapshot 2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-quobyte-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] snapshot: 2587ed99-81f3-4bfa-bbde-61fb8f2e10c7, volume: cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518a115-e2ea-4a66-9775-d277e14511d8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:00 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b123fede-3acf-4e45-9d07-8262d151f291" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-quobyte-b123fede-3acf-4e45-9d07-8262d151f291" released by "delete_volume" :: held 1.696s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:00 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 Jun 23 04:31:00 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Created reservations ['b4442afe-5602-4d68-a47c-0abf407a750c', 'ecf75291-1b83-4e24-bf11-10b2c08fdd36', 'f00c8268-3ca4-4acc-a954-d658bd9e1aec', '6c0e39f7-ecea-4b46-b271-3d6a4b9c2535'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:01 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:31:01 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Flow 'volume_create_manager' (b1d439cd-6745-4aa5-8815-a2eefa7c0766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edd57e2-17e7-4d3d-84e9-deb9fd56fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6edd57e2-17e7-4d3d-84e9-deb9fd56fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1759108289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4fb58e-476e-41cd-9cd0-1d538d4295ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd457cfc2f7432a924740b4b827518f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:31:01Z,use_quota=True,user_id='37f6fc7b732347aba70f7324c227e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37fe66b-bf5c-422f-98b0-ee27988638e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37fe66b-bf5c-422f-98b0-ee27988638e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d485e269-68d3-402c-9b0c-4dc8de00499b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d485e269-68d3-402c-9b0c-4dc8de00499b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4fb58e-476e-41cd-9cd0-1d538d4295ca', 'volume_name': 'volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7f83fe-7840-45b8-9e51-e60b9e84f644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee7f83fe-7840-45b8-9e51-e60b9e84f644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665cb86c-ad1a-48ee-8a8f-ec6e3fa09a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:01 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca', 'volume_size': 1} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "cinder-eadb99ea-d7fc-42b4-9d10-77d7724d62f8-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-eadb99ea-d7fc-42b4-9d10-77d7724d62f8-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "cinder-quobyte-eadb99ea-d7fc-42b4-9d10-77d7724d62f8" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-quobyte-eadb99ea-d7fc-42b4-9d10-77d7724d62f8" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c612c59-330a-41d4-b884-3ae21e6a0818]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:01 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" returned: 0 in 1.066s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094417c0-dc82-4d4b-89a2-d1f52a701cec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ba1ab1-802e-4271-9f4b-5b978abc35c4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:02 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 Jun 23 04:31:02 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:02 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:31:02 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:02 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.031s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:31:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Deleted volume successfully. Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8bc12b81-5723-4eb2-9203-b85d7da73004 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-b123fede-3acf-4e45-9d07-8262d151f291-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:02 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 1.017s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:02 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f Jun 23 04:31:02 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:02 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8" returned: 0 in 1.125s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:03 devstack sudo[105505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8 Jun 23 04:31:03 devstack sudo[105505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:03 devstack sudo[105505]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eadb99ea-d7fc-42b4-9d10-77d7724d62f8" returned: 0 in 0.866s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-quobyte-eadb99ea-d7fc-42b4-9d10-77d7724d62f8" released by "delete_volume" :: held 2.048s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:03 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Created reservations ['b040706c-16c1-4fed-89ee-b696fa01ac98', 'ea08e35a-5412-40a6-9a4e-9ed4351d2b71', '3ad58be2-3575-43b2-8f5e-3f2681bbb14d', 'e5367caa-5033-4edd-8a3b-ec7ce34b1617'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:04 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:31:04 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "cinder-966ae9a3-53cd-4021-868e-3133bc03fb1f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:05 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-966ae9a3-53cd-4021-868e-3133bc03fb1f-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.462s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:31:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Deleted volume successfully. Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "cinder-quobyte-966ae9a3-53cd-4021-868e-3133bc03fb1f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7881c340-8283-4af4-af36-b620ec6a98d0 tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-eadb99ea-d7fc-42b4-9d10-77d7724d62f8-delete_volume" released by "delete_volume" :: held 3.939s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-quobyte-966ae9a3-53cd-4021-868e-3133bc03fb1f" acquired by "delete_volume" :: waited 0.054s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1703aa-3b57-410e-aa86-7b1a3cd65581]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:06 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f Jun 23 04:31:06 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:07 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f" returned: 0 in 1.607s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:07 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f Jun 23 04:31:07 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:09 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-966ae9a3-53cd-4021-868e-3133bc03fb1f" returned: 0 in 1.709s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-quobyte-966ae9a3-53cd-4021-868e-3133bc03fb1f" released by "delete_volume" :: held 3.454s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Created reservations ['71fa6c51-da65-4a62-8e5b-748b586f4c76', '9172354e-de96-4e82-b0b2-223ce4ea8423', '8c26c1f5-ef20-4aec-aa33-bf8a1c2e8cea', '3caf7fda-c1bb-4939-b0d1-9f722b8e32af'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:09 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" returned: 0 in 6.428s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:09 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5abd3d6-6041-4bbf-bf20-d8678d16f66d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:09 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:09 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:31:09 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:10 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.881s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:10 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:31:10 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Deleted volume successfully. Jun 23 04:31:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e85d539-ac52-4c73-9d6f-403f0c3d416b tempest-VolumesListTestJSON-1043136844 None] Lock "cinder-966ae9a3-53cd-4021-868e-3133bc03fb1f-delete_volume" released by "delete_volume" :: held 4.836s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:10 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 1.402s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:10 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:31:10 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Converted 1024.00 MB image at 159.19 MB/s Jun 23 04:31:10 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f is being set with open permissions: ugo+rw Jun 23 04:31:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:10 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f Jun 23 04:31:10 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:11 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" returned: 0 in 0.969s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" released by "_copy_volume_from_snapshot" :: held 11.006s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" released by "_create_volume_from_snapshot" :: held 11.055s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.075s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.348s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1759108289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4fb58e-476e-41cd-9cd0-1d538d4295ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8dd457cfc2f7432a924740b4b827518f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:31:01Z,use_quota=True,user_id='37f6fc7b732347aba70f7324c227e2ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Creating volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:31:11 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:11 devstack sudo[105548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca 1073741824 Jun 23 04:31:11 devstack sudo[105548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (615729cb-88b2-47dd-abd3-1156a004748d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f', 'volume_size': 1, 'snapshot_id': '2587ed99-81f3-4bfa-bbde-61fb8f2e10c7'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd37f2ff-55b5-49f1-b2ea-ef3078f1ecc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:11 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Volume volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f (cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f): created successfully Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd37f2ff-55b5-49f1-b2ea-ef3078f1ecc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Flow 'volume_create_manager' (6286771c-7b52-496c-9200-8d8f626091a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-86faf3c6-3500-4c66-a1e8-3c1bcd011391 tempest-TestStampPattern-717296437 None] Created volume successfully. Jun 23 04:31:12 devstack sudo[105548]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca 1073741824" returned: 0 in 1.130s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:13 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca Jun 23 04:31:13 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:13 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" returned: 0 in 0.671s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.806s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (665cb86c-ad1a-48ee-8a8f-ec6e3fa09a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f6aea2-930b-4563-8190-e66c444968ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Creating offline snapshot aaf293e7-d16f-4487-ac6b-aebd5931f9de of volume 0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:31:13 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Volume volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca (7d4fb58e-476e-41cd-9cd0-1d538d4295ca): created successfully Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f6aea2-930b-4563-8190-e66c444968ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Flow 'volume_create_manager' (b1d439cd-6745-4aa5-8815-a2eefa7c0766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4086cff5-a4e7-4fb6-af2c-a99a2616f1c8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-be678e61-8fca-403f-b321-251bd8e4abfc tempest-SnapshotsActionsTest-464692217 None] Created volume successfully. Jun 23 04:31:13 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 Jun 23 04:31:13 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Flow 'volume_create_manager' (914c956d-15d1-4d47-8747-6139677fdbc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171e6edb-57f2-4eb6-a1f5-a53b72d27e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (171e6edb-57f2-4eb6-a1f5-a53b72d27e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1140509900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbde96ad-996c-4e8f-a8f2-268d87355938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8dec6cb204bbbb2ea48dc9eb5d944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:31:14Z,use_quota=True,user_id='f16a7ea621d345958b0250bf555fabe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a966b40-9017-4fe9-83c6-6240548f42db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a966b40-9017-4fe9-83c6-6240548f42db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bae9dd-5198-40c1-bd28-b4401a970430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25bae9dd-5198-40c1-bd28-b4401a970430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbde96ad-996c-4e8f-a8f2-268d87355938', 'volume_name': 'volume-fbde96ad-996c-4e8f-a8f2-268d87355938', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35eee94d-fbe3-4f58-b725-77b536e1a63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35eee94d-fbe3-4f58-b725-77b536e1a63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa95ee7f-dd7f-4bb3-a375-7124abf3554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:14 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Volume fbde96ad-996c-4e8f-a8f2-268d87355938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbde96ad-996c-4e8f-a8f2-268d87355938', 'volume_size': 1} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:14 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" returned: 0 in 0.851s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:14 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de 1G Jun 23 04:31:14 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:15 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de 1G" returned: 0 in 0.787s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:15 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de Jun 23 04:31:15 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:16 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de" returned: 0 in 0.684s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:16 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de is being set with open permissions: ugo+rw Jun 23 04:31:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:16 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de Jun 23 04:31:16 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:16 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de" returned: 0 in 0.666s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:16 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info Jun 23 04:31:16 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:17 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info" returned: 0 in 0.784s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:17 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info is being set with open permissions: ugo+rw Jun 23 04:31:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:17 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info Jun 23 04:31:17 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:18 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.info" returned: 0 in 0.723s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.633s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.037s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:31:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1140509900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbde96ad-996c-4e8f-a8f2-268d87355938,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ab8dec6cb204bbbb2ea48dc9eb5d944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:31:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:31:14Z,use_quota=True,user_id='f16a7ea621d345958b0250bf555fabe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Creating volume fbde96ad-996c-4e8f-a8f2-268d87355938 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:31:18 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:31:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2ec27048-31ee-4649-903b-66b18b4617a2 tempest-VolumesExtendTest-1839673539 None] Create snapshot completed successfully Jun 23 04:31:18 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 1073741824 Jun 23 04:31:18 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:19 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 1073741824" returned: 0 in 0.964s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:19 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 Jun 23 04:31:19 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:20 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938" returned: 0 in 0.863s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] <== create_volume: return (1882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.888s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.164s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa95ee7f-dd7f-4bb3-a375-7124abf3554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbde96ad-996c-4e8f-a8f2-268d87355938', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93cc49f-4c23-4e52-b02b-d4357d9a1db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Creating offline snapshot dd90dd79-e838-4870-9152-264c7c300a74 of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:31:20 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Volume volume-fbde96ad-996c-4e8f-a8f2-268d87355938 (fbde96ad-996c-4e8f-a8f2-268d87355938): created successfully Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f93cc49f-4c23-4e52-b02b-d4357d9a1db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Flow 'volume_create_manager' (914c956d-15d1-4d47-8747-6139677fdbc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2756610b-5ff7-4414-905f-53c7319309d0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8fe5dd7e-9277-4bec-9c40-e0126e6cac72 tempest-VolumesNegativeTest-775375806 None] Created volume successfully. Jun 23 04:31:20 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca Jun 23 04:31:20 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:21 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" returned: 0 in 1.074s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:21 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 1G Jun 23 04:31:21 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:22 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 1G" returned: 0 in 1.201s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:22 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:22 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:23 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 0.818s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:23 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 is being set with open permissions: ugo+rw Jun 23 04:31:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:23 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:23 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:24 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 0.719s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:24 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:INSERT=28,cinder:SELECT=77,cinder:UPDATE=106,cinder:DELETE=4 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:31:24 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=100,cinder:INSERT=27,cinder:UPDATE=91,cinder:DELETE=11 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:31:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:24 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info Jun 23 04:31:24 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:24 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info" returned: 0 in 0.656s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:24 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info is being set with open permissions: ugo+rw Jun 23 04:31:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:24 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info Jun 23 04:31:24 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:25 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.info" returned: 0 in 0.687s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.329s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 6.543s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d389f6f-e118-470e-ada1-ae0cba9dd6ce]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:25 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8ce0d0c6-3f9f-479c-a377-5bb0010afe4d tempest-SnapshotsActionsTest-464692217 None] Create snapshot completed successfully Jun 23 04:31:25 devstack sudo[105710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 Jun 23 04:31:25 devstack sudo[105710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:26 devstack sudo[105710]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" returned: 0 in 0.941s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de 2G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de 2G" returned: 0 in 0.296s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.284s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-40034bd4-c4b2-40c0-a2a2-af0cf6878611 tempest-VolumesExtendTest-1839673539 None] Extend volume completed successfully. Jun 23 04:31:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Creating offline snapshot 15e98863-eafa-422f-917c-a73621b8b37f of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:31:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d780cb6d-b299-4123-bace-44a3e50245fb]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:27 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:27 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-aaf293e7-d16f-4487-ac6b-aebd5931f9de-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-aaf293e7-d16f-4487-ac6b-aebd5931f9de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.083s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-quobyte-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-quobyte-aaf293e7-d16f-4487-ac6b-aebd5931f9de" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-aaf293e7-d16f-4487-ac6b-aebd5931f9de" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Deleting offline snapshot aaf293e7-d16f-4487-ac6b-aebd5931f9de of volume 0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] snapshot_file for this snap is: volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a71cc-7f35-426b-bb64-d39fd0676457]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:28 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de Jun 23 04:31:28 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:29 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.790s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:29 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f 1G Jun 23 04:31:29 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:29 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de" returned: 0 in 1.439s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e16cca-f75a-4990-8dda-19370b0bdd22]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:29 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 Jun 23 04:31:29 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:30 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f 1G" returned: 0 in 1.139s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:30 devstack sudo[105775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f Jun 23 04:31:30 devstack sudo[105775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:30 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" returned: 0 in 1.077s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:30 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de Jun 23 04:31:30 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:31 devstack sudo[105775]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f" returned: 0 in 0.796s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:31 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f is being set with open permissions: ugo+rw Jun 23 04:31:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:31 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f Jun 23 04:31:31 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:31 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de" returned: 0 in 0.882s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:31 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de Jun 23 04:31:31 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:31 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f" returned: 0 in 0.706s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.585s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-62f0b53b-ec0f-45f6-8681-ed5c5082d440 tempest-SnapshotsActionsTest-464692217 None] Create snapshot completed successfully Jun 23 04:31:32 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865.aaf293e7-d16f-4487-ac6b-aebd5931f9de" returned: 0 in 0.684s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-aaf293e7-d16f-4487-ac6b-aebd5931f9de" released by "_delete_snapshot" :: held 4.239s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" released by "delete_snapshot" :: held 4.276s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Created reservations ['3c4cc865-ac00-47ab-a245-feeff1e154a5', '9b73be50-c6ce-4168-a8b7-3c0afc7b347e', '75aa79bf-a72a-46cd-a97f-9eb7fa4edb91', 'ad77798f-6c34-4071-82be-9be85493c9a9'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Delete snapshot completed successfully. Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-7e536197-7539-4d70-aa86-5cd4081373fa tempest-VolumesExtendTest-1839673539 None] Lock "cinder-aaf293e7-d16f-4487-ac6b-aebd5931f9de-delete_snapshot" released by "delete_snapshot" :: held 4.430s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-15e98863-eafa-422f-917c-a73621b8b37f-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-15e98863-eafa-422f-917c-a73621b8b37f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-15e98863-eafa-422f-917c-a73621b8b37f" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-15e98863-eafa-422f-917c-a73621b8b37f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Deleting offline snapshot 15e98863-eafa-422f-917c-a73621b8b37f of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] snapshot_file for this snap is: volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f7b19c-8627-4302-bb10-ca10e094ca51]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:33 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f Jun 23 04:31:33 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Lock "cinder-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "cinder-quobyte-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d88f93-98cd-47cc-b0cc-785e6da4339d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:33 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 Jun 23 04:31:33 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:33 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f" returned: 0 in 0.800s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c671c3e3-ee07-4001-afad-b9e32e249d4c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:33 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:33 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:34 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" returned: 0 in 0.762s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:34 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865 Jun 23 04:31:34 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:34 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 0.827s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:34 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f Jun 23 04:31:34 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:35 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" returned: 0 in 0.664s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Lock "cinder-quobyte-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865" released by "delete_volume" :: held 1.499s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Created reservations ['d5fc1dae-96a6-43dd-a45b-48f3db8c0c11', 'dc64481f-cef8-4c5a-b0b4-6f4dc48472e1', 'da60c2d2-e044-4636-b7e0-bb1ce52b519e', '0b3cd870-bc6b-4f1c-9117-307b13900ad0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:35 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:31:35 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:35 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f" returned: 0 in 0.813s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:35 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f Jun 23 04:31:35 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:36 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.996s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:31:36 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Deleted volume successfully. Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-96f669f0-8ad3-4665-8b2d-9a9441799972 tempest-VolumesExtendTest-1839673539 None] Lock "cinder-0a5c5e37-0a09-4b4f-a0b5-5bc1d1685865-delete_volume" released by "delete_volume" :: held 2.766s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:36 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.15e98863-eafa-422f-917c-a73621b8b37f" returned: 0 in 1.139s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-15e98863-eafa-422f-917c-a73621b8b37f" released by "_delete_snapshot" :: held 3.724s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" released by "delete_snapshot" :: held 3.770s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:36 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Created reservations ['40178443-26f5-4eee-b0b5-95c4030ef952', 'd7be5e15-0deb-4034-bfcc-de42ee2caf4c', 'a98f527c-272d-4a43-b5c5-969b7ba6839e', '5a170904-9509-444c-ba75-f81aabcfd782'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Delete snapshot completed successfully. Jun 23 04:31:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-02ecbe11-96ca-4ac7-aadd-a34579e4f7a6 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-15e98863-eafa-422f-917c-a73621b8b37f-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Creating offline snapshot 4b3e3667-e1dc-4fde-ac6b-704371ffe768 of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:31:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d5e3a-498a-4299-b680-f589aa553a72]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:37 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:37 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:38 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.184s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:38 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 1G Jun 23 04:31:38 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:40 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 1G" returned: 0 in 1.177s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:40 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 Jun 23 04:31:40 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:41 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768" returned: 0 in 1.063s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:41 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 is being set with open permissions: ugo+rw Jun 23 04:31:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:41 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 Jun 23 04:31:41 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:42 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768" returned: 0 in 0.931s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.495s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:42 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-831efdfd-d672-4fdb-9650-9bd67aa371b1 tempest-SnapshotsActionsTest-464692217 None] Create snapshot completed successfully Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-4b3e3667-e1dc-4fde-ac6b-704371ffe768-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-4b3e3667-e1dc-4fde-ac6b-704371ffe768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-4b3e3667-e1dc-4fde-ac6b-704371ffe768" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-4b3e3667-e1dc-4fde-ac6b-704371ffe768" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Deleting offline snapshot 4b3e3667-e1dc-4fde-ac6b-704371ffe768 of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] snapshot_file for this snap is: volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e5d8a-728e-4e33-9af4-44869879e9a0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:43 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 Jun 23 04:31:43 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:44 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768" returned: 0 in 1.177s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:44 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae53d92-cb3f-46e2-857c-f5444b6cf5b6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:44 devstack sudo[105996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:44 devstack sudo[105996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:45 devstack sudo[105996]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.050s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:45 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 Jun 23 04:31:45 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:46 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768" returned: 0 in 0.963s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:46 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768 Jun 23 04:31:46 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:47 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.4b3e3667-e1dc-4fde-ac6b-704371ffe768" returned: 0 in 0.685s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-4b3e3667-e1dc-4fde-ac6b-704371ffe768" released by "_delete_snapshot" :: held 4.030s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" released by "delete_snapshot" :: held 4.066s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Created reservations ['de222474-5c51-4dbb-8dbd-717bf7ae6cd8', '4a0bd294-3c4c-445b-aef9-595c9e99910f', '7792e5d3-e092-41b1-b808-4b4b2b5bd4ee', 'ef5e0868-8718-4279-a46c-74bdfac5ed0d'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:47 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Delete snapshot completed successfully. Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49a50188-080f-4376-a10d-f3f277d5dd6f tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-4b3e3667-e1dc-4fde-ac6b-704371ffe768-delete_snapshot" released by "delete_snapshot" :: held 4.259s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Creating offline snapshot 2361354c-827a-4d36-8db8-ee847375ff8c of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:31:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cb9caf-0284-4297-af5c-2c48d2047fb0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:48 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:48 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:49 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 0.983s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:49 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c 1G Jun 23 04:31:49 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:50 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c 1G" returned: 0 in 1.120s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:50 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c Jun 23 04:31:50 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:51 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c" returned: 0 in 0.848s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:51 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c is being set with open permissions: ugo+rw Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:51 devstack sudo[106046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c Jun 23 04:31:51 devstack sudo[106046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:51 devstack sudo[106046]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c" returned: 0 in 0.773s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.892s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.556s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdef240-257e-498a-b3f0-d431e4e4921f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9a6d52dd-9dba-477b-91b5-91258956cdc1 tempest-SnapshotsActionsTest-464692217 None] Create snapshot completed successfully Jun 23 04:31:52 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f Jun 23 04:31:52 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-2361354c-827a-4d36-8db8-ee847375ff8c-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-2361354c-827a-4d36-8db8-ee847375ff8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-2361354c-827a-4d36-8db8-ee847375ff8c" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-2361354c-827a-4d36-8db8-ee847375ff8c" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Deleting offline snapshot 2361354c-827a-4d36-8db8-ee847375ff8c of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] snapshot_file for this snap is: volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f2e229-8695-4f5a-b0a5-2d8f07c81057]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:52 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c Jun 23 04:31:52 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:52 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" returned: 0 in 0.894s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.922s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9586cc69-1548-485b-a3c8-12601da96e42', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:31:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-682e5656-a740-4466-a0ee-cad17fa1d949 req-8d5b7985-64c5-4356-87af-9040d42ed2e9 tempest-TestStampPattern-717296437 None] attachment_update completed successfully. Jun 23 04:31:53 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c" returned: 0 in 1.078s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ebca2-48ab-46fd-a07a-01b6d272a44c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:53 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:53 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:54 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 0.987s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:54 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:31:54 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:54 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c Jun 23 04:31:54 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Acquiring lock "cinder-fbde96ad-996c-4e8f-a8f2-268d87355938-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Lock "cinder-fbde96ad-996c-4e8f-a8f2-268d87355938-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Acquiring lock "cinder-quobyte-fbde96ad-996c-4e8f-a8f2-268d87355938" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Lock "cinder-quobyte-fbde96ad-996c-4e8f-a8f2-268d87355938" acquired by "delete_volume" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:31:55 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.007s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[83842bf7-12a2-4dba-a2c6-9155b2370eaa]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:31:55 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 Jun 23 04:31:55 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:55 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c" returned: 0 in 1.154s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:55 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c Jun 23 04:31:55 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:56 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.2361354c-827a-4d36-8db8-ee847375ff8c" returned: 0 in 0.711s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:56 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938" returned: 0 in 0.921s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-2361354c-827a-4d36-8db8-ee847375ff8c" released by "_delete_snapshot" :: held 4.117s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" released by "delete_snapshot" :: held 4.153s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:56 devstack sudo[106465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938 Jun 23 04:31:56 devstack sudo[106465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Created reservations ['6778d31f-0977-4212-866b-031c47d2a532', 'd6122bda-67d6-44a8-bfef-97692970ab3b', '8b01bbb0-eddf-4dfd-9739-be96532e680e', 'a14e9525-7a3e-423e-886e-08e1a61f0f7c'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Delete snapshot completed successfully. Jun 23 04:31:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e9b70cb6-27c9-4aa8-a756-2f9350ca5a99 tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-2361354c-827a-4d36-8db8-ee847375ff8c-delete_snapshot" released by "delete_snapshot" :: held 4.343s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:57 devstack sudo[106465]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-fbde96ad-996c-4e8f-a8f2-268d87355938" returned: 0 in 0.822s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Lock "cinder-quobyte-fbde96ad-996c-4e8f-a8f2-268d87355938" released by "delete_volume" :: held 1.793s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Created reservations ['66799f96-61fe-4a48-966c-80787b2d6d67', 'ce2608ae-eb9c-46bd-b529-ded888b2af18', 'edd1c9b9-8459-43b3-b117-36c881060a37', 'f7fa80a5-349d-4a67-a020-c4e507665821'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:31:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:57 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:31:57 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.996s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:31:58 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:58 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Deleted volume successfully. Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Creating offline snapshot 84b84c50-660e-4ec5-a11d-489a7ddfda2d of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-53ac63e4-85ab-4716-b40c-0d218d11b5b6 tempest-VolumesNegativeTest-775375806 None] Lock "cinder-fbde96ad-996c-4e8f-a8f2-268d87355938-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb959ddf-65e4-42f1-865f-c697f631f934]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:31:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:58 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:31:58 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:31:59 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jun 23 04:31:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.028s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:31:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:31:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:31:59 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d 1G Jun 23 04:31:59 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-54a2abdc-cfd8-4528-a51f-63921b683bd5 req-64ef3436-cbca-4f21-829e-ee439d50ea80 tempest-TestStampPattern-717296437 None] Terminate volume connection completed successfully. Jun 23 04:32:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-54a2abdc-cfd8-4528-a51f-63921b683bd5 req-64ef3436-cbca-4f21-829e-ee439d50ea80 tempest-TestStampPattern-717296437 None] Deleting attachment 9586cc69-1548-485b-a3c8-12601da96e42. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:32:01 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d 1G" returned: 0 in 1.424s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:01 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d Jun 23 04:32:01 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:02 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d" returned: 0 in 0.826s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:02 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d is being set with open permissions: ugo+rw Jun 23 04:32:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:02 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d Jun 23 04:32:02 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:02 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d" returned: 0 in 0.806s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.392s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0ab34251-7e8b-4b05-91fb-10727e0bface tempest-SnapshotsActionsTest-464692217 None] Create snapshot completed successfully Jun 23 04:32:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-84b84c50-660e-4ec5-a11d-489a7ddfda2d-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-84b84c50-660e-4ec5-a11d-489a7ddfda2d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Acquiring lock "cinder-quobyte-84b84c50-660e-4ec5-a11d-489a7ddfda2d" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-84b84c50-660e-4ec5-a11d-489a7ddfda2d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Deleting offline snapshot 84b84c50-660e-4ec5-a11d-489a7ddfda2d of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] snapshot_file for this snap is: volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a445a-5e1d-49fc-8791-ec21b181762b]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:04 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d Jun 23 04:32:04 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:05 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d" returned: 0 in 1.089s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:32:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c44d609-59d9-4cec-8de1-1be8d0c4f63d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:05 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:32:05 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Flow 'volume_create_manager' (815b9ae7-63a0-4146-a193-d8ca69763f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea8de4b-a7d9-4634-853f-5181b269762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea8de4b-a7d9-4634-853f-5181b269762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2009917905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d6cb09-df24-4c66-b13e-1f2c4ca81812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400f421e47a34063ae0979d0ddb0e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:06Z,use_quota=True,user_id='78ec8d458ec34a7c9df7af073477bbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1478af-c54e-4140-82d6-688968f7823a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1478af-c54e-4140-82d6-688968f7823a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839fd180-e879-46bb-9366-fee7160c8f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (839fd180-e879-46bb-9366-fee7160c8f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d6cb09-df24-4c66-b13e-1f2c4ca81812', 'volume_name': 'volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b771cee-0c92-4304-9e3a-6200de2219c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b771cee-0c92-4304-9e3a-6200de2219c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d080df-3214-42ca-b805-c28311df6945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Volume f7d6cb09-df24-4c66-b13e-1f2c4ca81812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812', 'volume_size': 1} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2009917905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d6cb09-df24-4c66-b13e-1f2c4ca81812,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400f421e47a34063ae0979d0ddb0e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:06Z,use_quota=True,user_id='78ec8d458ec34a7c9df7af073477bbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Creating volume f7d6cb09-df24-4c66-b13e-1f2c4ca81812 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:06 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:06 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 1073741824 Jun 23 04:32:06 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:06 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.432s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:32:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:06 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d Jun 23 04:32:06 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Flow 'volume_create_manager' (8932f1a3-f5a2-4b02-9595-1a815e8d1a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e179191-aa64-416d-8351-25678656d87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e179191-aa64-416d-8351-25678656d87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-22205947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35156b5d-8dc3-4057-8fb1-9d029f509ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400f421e47a34063ae0979d0ddb0e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:07Z,use_quota=True,user_id='78ec8d458ec34a7c9df7af073477bbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf825677-0a32-4e4f-ae4e-44614c05baa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf825677-0a32-4e4f-ae4e-44614c05baa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeef236-2608-419e-b8ce-3ba7c03950b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aeef236-2608-419e-b8ce-3ba7c03950b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35156b5d-8dc3-4057-8fb1-9d029f509ab0', 'volume_name': 'volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d319798-9aa8-4ac6-9586-72c8e831721f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d319798-9aa8-4ac6-9586-72c8e831721f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff9e9a-690e-428a-b7a0-abd681f7f552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:07 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Volume 35156b5d-8dc3-4057-8fb1-9d029f509ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0', 'volume_size': 1} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:07 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 1073741824" returned: 0 in 1.163s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:07 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 Jun 23 04:32:07 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:08 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d" returned: 0 in 1.287s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:08 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d Jun 23 04:32:08 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:08 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" returned: 0 in 0.908s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.439s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-22205947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35156b5d-8dc3-4057-8fb1-9d029f509ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='400f421e47a34063ae0979d0ddb0e6a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:07Z,use_quota=True,user_id='78ec8d458ec34a7c9df7af073477bbeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Creating volume 35156b5d-8dc3-4057-8fb1-9d029f509ab0 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:08 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60d080df-3214-42ca-b805-c28311df6945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b1c803-6bba-49ae-a03e-b4aff959808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:08 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 1073741824 Jun 23 04:32:08 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:08 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Volume volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 (f7d6cb09-df24-4c66-b13e-1f2c4ca81812): created successfully Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b1c803-6bba-49ae-a03e-b4aff959808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Flow 'volume_create_manager' (815b9ae7-63a0-4146-a193-d8ca69763f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-02d1c41b-5326-4193-b05e-bf484e52de6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Created volume successfully. Jun 23 04:32:09 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.84b84c50-660e-4ec5-a11d-489a7ddfda2d" returned: 0 in 0.983s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-84b84c50-660e-4ec5-a11d-489a7ddfda2d" released by "_delete_snapshot" :: held 5.013s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" released by "delete_snapshot" :: held 5.040s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:09 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Created reservations ['7d6bbd9c-442f-449b-9efe-2e5ffde507f1', '6c3b97fc-e59d-4a55-beb2-92dff9cf6466', '5e963e71-0cbc-4dbc-94d2-ffab59f65f8b', '7542ec62-5cf4-4327-818d-130d736a6694'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Delete snapshot completed successfully. Jun 23 04:32:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-83f529e5-c646-4d4c-843f-796c9b205a4b tempest-SnapshotsActionsTest-1924494920 None] Lock "cinder-84b84c50-660e-4ec5-a11d-489a7ddfda2d-delete_snapshot" released by "delete_snapshot" :: held 5.244s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "cinder-dd90dd79-e838-4870-9152-264c7c300a74-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-dd90dd79-e838-4870-9152-264c7c300a74-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "cinder-quobyte-dd90dd79-e838-4870-9152-264c7c300a74" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-quobyte-dd90dd79-e838-4870-9152-264c7c300a74" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Deleting offline snapshot dd90dd79-e838-4870-9152-264c7c300a74 of volume 7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] snapshot_file for this snap is: volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[22960ba8-5dfd-461e-a49c-eb247deca675]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:10 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 1073741824" returned: 0 in 1.430s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:10 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:32:10 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:10 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 Jun 23 04:32:10 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:11 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0" returned: 0 in 0.807s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] <== create_volume: return (2329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff9e9a-690e-428a-b7a0-abd681f7f552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e8a174-9948-4ee7-a933-0622be0b4aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:11 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Volume volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 (35156b5d-8dc3-4057-8fb1-9d029f509ab0): created successfully Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1e8a174-9948-4ee7-a933-0622be0b4aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Flow 'volume_create_manager' (8932f1a3-f5a2-4b02-9595-1a815e8d1a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9c88dbff-488e-43a8-9400-686b86725f92 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Created volume successfully. Jun 23 04:32:11 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.090s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be90ccb-f7e0-4828-bc30-4a2444f4e16c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:11 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca Jun 23 04:32:11 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Lock "cinder-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-quobyte-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a676db38-4d81-44d6-920b-77716e192004]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:12 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f Jun 23 04:32:12 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:12 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" returned: 0 in 1.165s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:12 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:32:12 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:13 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" returned: 0 in 1.021s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:13 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f Jun 23 04:32:13 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:13 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.043s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:13 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74 Jun 23 04:32:13 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:14 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" returned: 0 in 0.919s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f" released by "delete_volume" :: held 2.033s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Created reservations ['44bad884-41f2-4612-bf29-bfe758e9fc03', '2119ffcb-248c-40f1-a4e6-3d7ef1dad5bc', 'cc9bc037-a1ad-43de-abc3-01ae29421bec', '866cf4d0-03d2-40fb-ba14-2fcc43f1945e'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:14 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:32:14 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:14 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca.dd90dd79-e838-4870-9152-264c7c300a74" returned: 0 in 1.279s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-quobyte-dd90dd79-e838-4870-9152-264c7c300a74" released by "_delete_snapshot" :: held 4.820s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" released by "delete_snapshot" :: held 4.862s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Created reservations ['bf87ae32-bef2-4c20-a800-db04b9507fc6', '3960b069-fc34-478d-b2d9-92c8669d8854', '906b945a-ed84-4cb6-a74e-c801de75f4b7', 'f8ce903e-fbe6-45f2-9595-cf51abb17a71'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Delete snapshot completed successfully. Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0efe8f43-22d2-43d3-9d76-fde1166841e0 tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-dd90dd79-e838-4870-9152-264c7c300a74-delete_snapshot" released by "delete_snapshot" :: held 5.138s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "cinder-7d4fb58e-476e-41cd-9cd0-1d538d4295ca-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:15 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.236s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-7d4fb58e-476e-41cd-9cd0-1d538d4295ca-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Deleted volume successfully. Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-66fd91c0-2157-4893-9dd8-b73f44f6fc4b tempest-TestStampPattern-717296437 None] Lock "cinder-cc15bf94-fdbb-42fc-9b46-caa8ebb33e2f-delete_volume" released by "delete_volume" :: held 3.780s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffb035e-f345-4f2f-9c2d-635681c9e3be]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Lock "cinder-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-quobyte-094417c0-dc82-4d4b-89a2-d1f52a701cec" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:16 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca Jun 23 04:32:16 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-094417c0-dc82-4d4b-89a2-d1f52a701cec" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-quobyte-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Deleting offline snapshot 2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 of volume 094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] snapshot_file for this snap is: volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cd0e4f-2f6a-41b8-9e81-9d8ad17bb152]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:16 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 Jun 23 04:32:16 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:16 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" returned: 0 in 1.111s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:16 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca Jun 23 04:32:16 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:17 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" returned: 0 in 0.867s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-094417c0-dc82-4d4b-89a2-d1f52a701cec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[466d27d2-ec46-4e29-be70-854c07621b93]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:17 devstack sudo[106701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:32:17 devstack sudo[106701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (a2f7411a-1dbf-4b88-bf69-355666851a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0132ff6b-7a2f-450e-b75f-88e414830844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0132ff6b-7a2f-450e-b75f-88e414830844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-419274022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff804844-ecc2-4be9-9682-7a0ce6797d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:17Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbd6b8c-fd31-4bd5-8c44-16a6bc27f80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdbd6b8c-fd31-4bd5-8c44-16a6bc27f80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad843b77-ff19-471d-9fe5-29620d3e60ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad843b77-ff19-471d-9fe5-29620d3e60ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff804844-ecc2-4be9-9682-7a0ce6797d1f', 'volume_name': 'volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c11ed0-3684-48d4-98a3-484f26f8c86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16c11ed0-3684-48d4-98a3-484f26f8c86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61adfcb-78a3-4dc1-a586-e1f9b82984c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Volume ff804844-ecc2-4be9-9682-7a0ce6797d1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f', 'volume_size': 1} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-419274022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff804844-ecc2-4be9-9682-7a0ce6797d1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:17Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Creating volume ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:17 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:17 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f 1073741824 Jun 23 04:32:17 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:17 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" returned: 0 in 0.733s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-quobyte-7d4fb58e-476e-41cd-9cd0-1d538d4295ca" released by "delete_volume" :: held 1.933s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Created reservations ['533536e7-35f8-4b8a-982d-db31e85ebc78', 'e8b9bc8f-337c-4524-b197-7b9d4bdc18ad', '0da79858-b60c-4f65-8737-09deec298f4c', 'ad9208e0-5630-4ded-9f83-392e2cc75d3f'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:17 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:32:17 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:17 devstack sudo[106701]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 0.921s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:18 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 Jun 23 04:32:18 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:18 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f 1073741824" returned: 0 in 1.082s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:18 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f Jun 23 04:32:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:18 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.854s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:32:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Deleted volume successfully. Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b64bdfc5-98b3-43b9-ba57-93d8dca7277e tempest-SnapshotsActionsTest-464692217 None] Lock "cinder-7d4fb58e-476e-41cd-9cd0-1d538d4295ca-delete_volume" released by "delete_volume" :: held 3.168s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:18 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" returned: 0 in 0.960s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:18 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7 Jun 23 04:32:18 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:19 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f" returned: 0 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d61adfcb-78a3-4dc1-a586-e1f9b82984c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc4f06b-a232-45da-9614-dd90ccd3407d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:19 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Volume volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f (ff804844-ecc2-4be9-9682-7a0ce6797d1f): created successfully Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc4f06b-a232-45da-9614-dd90ccd3407d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (a2f7411a-1dbf-4b88-bf69-355666851a9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-144b18f5-4677-4aab-a00f-ce81b5cd9915 tempest-VolumesSnapshotTestJSON-413637895 None] Created volume successfully. Jun 23 04:32:19 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec.2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" returned: 0 in 0.868s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7" released by "_delete_snapshot" :: held 3.755s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-094417c0-dc82-4d4b-89a2-d1f52a701cec" released by "delete_snapshot" :: held 3.794s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Created reservations ['ceb88b9b-dcfa-4cac-868e-043c6c25f9fb', '938d9e89-23b6-45d2-a799-d4046a714270', '96bef9ab-f627-4a34-97ef-394b1a2509ce', '91d4d8b2-875e-4791-b51d-4e1f0084ccb6'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Delete snapshot completed successfully. Jun 23 04:32:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5e318ade-82c0-4730-9398-8ab43b5afd82 tempest-TestStampPattern-717296437 None] Lock "cinder-2587ed99-81f3-4bfa-bbde-61fb8f2e10c7-delete_snapshot" released by "delete_snapshot" :: held 4.030s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Creating offline snapshot fae11689-fd21-4ad8-a255-ba691e4b37c0 of volume ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:32:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6353d5b6-3067-45a3-8724-0bf4ae4966e3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:21 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f Jun 23 04:32:21 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:21 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f" returned: 0 in 1.049s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:22 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 1G Jun 23 04:32:22 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:23 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 1G" returned: 0 in 1.160s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:23 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 Jun 23 04:32:23 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:24 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0" returned: 0 in 1.176s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:24 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 is being set with open permissions: ugo+rw Jun 23 04:32:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:24 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 Jun 23 04:32:24 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:24 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0" returned: 0 in 0.659s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:24 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=83,cinder:UPDATE=94,cinder:DELETE=8,cinder:INSERT=23 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:32:24 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=82,cinder:UPDATE=85,cinder:INSERT=25,cinder:DELETE=4 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:32:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:25 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info Jun 23 04:32:25 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:25 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info" returned: 0 in 0.860s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:25 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info is being set with open permissions: ugo+rw Jun 23 04:32:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:25 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info Jun 23 04:32:25 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:26 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.info" returned: 0 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.767s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6967d39-cab9-43e3-93f6-f5290b3c507d tempest-VolumesSnapshotTestJSON-413637895 None] Create snapshot completed successfully Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-fae11689-fd21-4ad8-a255-ba691e4b37c0-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-fae11689-fd21-4ad8-a255-ba691e4b37c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-ff804844-ecc2-4be9-9682-7a0ce6797d1f" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-ff804844-ecc2-4be9-9682-7a0ce6797d1f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-fae11689-fd21-4ad8-a255-ba691e4b37c0" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-fae11689-fd21-4ad8-a255-ba691e4b37c0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Deleting offline snapshot fae11689-fd21-4ad8-a255-ba691e4b37c0 of volume ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] snapshot_file for this snap is: volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff34f1f8-e011-4dc8-a8da-ab56e27a8c78]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:27 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 Jun 23 04:32:27 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:28 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0" returned: 0 in 1.202s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:32:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[596abec4-49ec-49b3-9185-5c101857e30b]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:29 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f Jun 23 04:32:29 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-094417c0-dc82-4d4b-89a2-d1f52a701cec-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Lock "cinder-094417c0-dc82-4d4b-89a2-d1f52a701cec-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Acquiring lock "cinder-quobyte-094417c0-dc82-4d4b-89a2-d1f52a701cec" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-094417c0-dc82-4d4b-89a2-d1f52a701cec" acquired by "delete_volume" :: waited 0.054s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d2a52a-ab66-48a1-b63f-2f486a6cbc4e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:29 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:32:29 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:30 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f" returned: 0 in 1.464s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:30 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 Jun 23 04:32:30 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 1.329s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:31 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec Jun 23 04:32:31 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:31 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0" returned: 0 in 1.460s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:31 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0 Jun 23 04:32:31 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:32 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-094417c0-dc82-4d4b-89a2-d1f52a701cec" returned: 0 in 1.219s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Lock "cinder-quobyte-094417c0-dc82-4d4b-89a2-d1f52a701cec" released by "delete_volume" :: held 2.688s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Created reservations ['ac6f4d6a-e3cc-4805-b0e5-9f527d9e8569', '220a49e5-4dad-4232-ba47-d376bfd49313', '08479ef6-28b5-47af-b404-74b334f561aa', 'd10464d7-d51e-4c15-a60f-9fd1ad890b02'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:32 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:32:32 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:32 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f.fae11689-fd21-4ad8-a255-ba691e4b37c0" returned: 0 in 0.976s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-fae11689-fd21-4ad8-a255-ba691e4b37c0" released by "_delete_snapshot" :: held 5.324s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-ff804844-ecc2-4be9-9682-7a0ce6797d1f" released by "delete_snapshot" :: held 5.371s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:32 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['f664d786-5f06-46e9-bc92-89105ea09c1b', '3202770e-8d30-4dd5-99e3-a5549b3ee594', '03e8679b-58ec-48ce-bdd3-ad0d5d24f486', '99e2b9d6-dfc0-4317-a5c0-d6d703ac141c'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Delete snapshot completed successfully. Jun 23 04:32:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-003cf46f-8d7b-41d3-b7cd-a41a1fcc3c37 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-fae11689-fd21-4ad8-a255-ba691e4b37c0-delete_snapshot" released by "delete_snapshot" :: held 5.694s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:33 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.075s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:33 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:32:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Deleted volume successfully. Jun 23 04:32:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-79f52c26-2f34-4f5b-873f-0954a1576b3a tempest-TestStampPattern-717296437 None] Lock "cinder-094417c0-dc82-4d4b-89a2-d1f52a701cec-delete_volume" released by "delete_volume" :: held 4.188s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:34 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (a6794ec4-9bed-413a-8f77-abdca1371e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4086f40-7c55-4207-af16-8dac643d9195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4086f40-7c55-4207-af16-8dac643d9195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1587332638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a2276b-2824-4297-9e87-8798869e3713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:35Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:34 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecc20af-0448-4c57-842e-7fc534984a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ecc20af-0448-4c57-842e-7fc534984a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7625cbd4-cc10-405a-8b74-6f0f1db8f0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7625cbd4-cc10-405a-8b74-6f0f1db8f0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6a2276b-2824-4297-9e87-8798869e3713', 'volume_name': 'volume-b6a2276b-2824-4297-9e87-8798869e3713', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806d19e9-0c1e-4d43-883c-47ea2d9ecf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806d19e9-0c1e-4d43-883c-47ea2d9ecf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00089950-230c-4106-a2d9-dfd31cef36ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:35 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Volume b6a2276b-2824-4297-9e87-8798869e3713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6a2276b-2824-4297-9e87-8798869e3713', 'volume_size': 1} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1587332638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a2276b-2824-4297-9e87-8798869e3713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:35Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Creating volume b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:35 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:35 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 1073741824 Jun 23 04:32:35 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:36 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 1073741824" returned: 0 in 1.184s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:36 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:32:36 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:37 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 0.931s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00089950-230c-4106-a2d9-dfd31cef36ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a2276b-2824-4297-9e87-8798869e3713', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c6652e-07e8-43d3-a5d3-20aba1502919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:37 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Volume volume-b6a2276b-2824-4297-9e87-8798869e3713 (b6a2276b-2824-4297-9e87-8798869e3713): created successfully Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c6652e-07e8-43d3-a5d3-20aba1502919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:37 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (a6794ec4-9bed-413a-8f77-abdca1371e8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c13d48b8-7272-4669-b39c-7d2c445c9a81 tempest-VolumesSnapshotTestJSON-413637895 None] Created volume successfully. Jun 23 04:32:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Creating offline snapshot 9cbc2811-7e67-4a34-b172-9cefcf36982f of volume b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:32:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54df10e4-0e47-484f-921e-a17118ed684d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:38 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:32:38 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:39 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 1.233s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:39 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f 1G Jun 23 04:32:39 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:41 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f 1G" returned: 0 in 1.191s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a2276b-2824-4297-9e87-8798869e3713 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:41 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a2276b-2824-4297-9e87-8798869e3713 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f Jun 23 04:32:41 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:42 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6a2276b-2824-4297-9e87-8798869e3713 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f" returned: 0 in 0.928s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:42 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f is being set with open permissions: ugo+rw Jun 23 04:32:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:42 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f Jun 23 04:32:42 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:43 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f" returned: 0 in 0.990s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:43 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info Jun 23 04:32:43 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Flow 'volume_create_manager' (84448d41-24ba-48c4-aabb-00b4e4b414ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4d4bfd-0fc0-40b8-8574-2dbac6683c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:43 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info" returned: 0 in 0.845s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:43 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info is being set with open permissions: ugo+rw Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a4d4bfd-0fc0-40b8-8574-2dbac6683c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1896049826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb863742-7ca9-4ce0-ac24-0e67a291bb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d89a82c03d4bfdb815930b49a66588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:44Z,use_quota=True,user_id='8787a5470f324788ada4020cd7d9d1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773dbc48-c3ae-4177-b4ce-414bb5c43584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:43 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (773dbc48-c3ae-4177-b4ce-414bb5c43584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:43 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3874fae-fa16-48df-9ea4-83a64208b1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3874fae-fa16-48df-9ea4-83a64208b1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb863742-7ca9-4ce0-ac24-0e67a291bb89', 'volume_name': 'volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2c00b5-e0b0-43e3-b4d2-6ee839edf2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2c00b5-e0b0-43e3-b4d2-6ee839edf2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25010f7-a16c-44e6-80ce-cc7e0fb26c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:43 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Volume eb863742-7ca9-4ce0-ac24-0e67a291bb89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89', 'volume_size': 1} Jun 23 04:32:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:44 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.info" returned: 0 in 0.719s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.043s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.685s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1896049826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb863742-7ca9-4ce0-ac24-0e67a291bb89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d89a82c03d4bfdb815930b49a66588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:44Z,use_quota=True,user_id='8787a5470f324788ada4020cd7d9d1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Creating volume eb863742-7ca9-4ce0-ac24-0e67a291bb89 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:44 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:44 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 1073741824 Jun 23 04:32:44 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:44 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8196ea66-45df-4538-b7f9-fc4698ead4a2 tempest-VolumesSnapshotTestJSON-413637895 None] Create snapshot completed successfully Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:45 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (c67028f6-d744-4df0-9632-3982e1ab033e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c220b0-16c0-47e4-b0bb-2a3aea2abd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 1073741824" returned: 0 in 0.980s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72c220b0-16c0-47e4-b0bb-2a3aea2abd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1401109840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b82844-fc87-4692-b9c2-847901507e85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:45Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9cbc2811-7e67-4a34-b172-9cefcf36982f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:46Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc75072-e1da-4e13-908c-7581f99f12b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc75072-e1da-4e13-908c-7581f99f12b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4124ef0a-ec6a-43bb-a81a-27ad59a1521f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4124ef0a-ec6a-43bb-a81a-27ad59a1521f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '72b82844-fc87-4692-b9c2-847901507e85', 'volume_name': 'volume-72b82844-fc87-4692-b9c2-847901507e85', 'volume_size': 2, 'snapshot_id': '9cbc2811-7e67-4a34-b172-9cefcf36982f'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3756ea3c-a6cc-468a-a0f6-bd253dd5163a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3756ea3c-a6cc-468a-a0f6-bd253dd5163a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff2b89-5481-477e-b953-56ec0c71ed9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:45 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Volume 72b82844-fc87-4692-b9c2-847901507e85: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-72b82844-fc87-4692-b9c2-847901507e85', 'volume_size': 2, 'snapshot_id': '9cbc2811-7e67-4a34-b172-9cefcf36982f'} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:45 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 Jun 23 04:32:45 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:46 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89" returned: 0 in 0.693s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.716s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-9cbc2811-7e67-4a34-b172-9cefcf36982f-72b82844-fc87-4692-b9c2-847901507e85" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25010f7-a16c-44e6-80ce-cc7e0fb26c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ac2ae-22e6-458a-9ed8-e6a96e5a559c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9cbc2811-7e67-4a34-b172-9cefcf36982f-72b82844-fc87-4692-b9c2-847901507e85" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Creating volume 72b82844-fc87-4692-b9c2-847901507e85 from snapshot 9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-72b82844-fc87-4692-b9c2-847901507e85" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Volume volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 (eb863742-7ca9-4ce0-ac24-0e67a291bb89): created successfully Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ac2ae-22e6-458a-9ed8-e6a96e5a559c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Flow 'volume_create_manager' (84448d41-24ba-48c4-aabb-00b4e4b414ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-72b82844-fc87-4692-b9c2-847901507e85" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] snapshot: 9cbc2811-7e67-4a34-b172-9cefcf36982f, volume: 72b82844-fc87-4692-b9c2-847901507e85, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:32:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8fe2b388-1e09-4cb7-9920-32edbb6a198a tempest-VolumeQuotasAdminTestJSON-960456075 None] Created volume successfully. Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1bd5b0-ece1-44f7-a9a3-ca914bcfed59]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:46 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f Jun 23 04:32:46 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "cinder-eb863742-7ca9-4ce0-ac24-0e67a291bb89-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "cinder-eb863742-7ca9-4ce0-ac24-0e67a291bb89-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "cinder-quobyte-eb863742-7ca9-4ce0-ac24-0e67a291bb89" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "cinder-quobyte-eb863742-7ca9-4ce0-ac24-0e67a291bb89" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c28230-5612-4267-ad54-eeb8ae594d17]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:47 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 Jun 23 04:32:47 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:47 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f" returned: 0 in 0.828s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a2276b-2824-4297-9e87-8798869e3713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d950f70-a856-4cd8-a34a-83f92f04ee6a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:47 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:32:47 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (aaa8e5b5-d8fa-45d2-aaff-02e922b5b089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6f90c5-18d2-4394-9d0c-1be89cb5fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6f90c5-18d2-4394-9d0c-1be89cb5fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049646458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9086b0-fb26-4e49-82e6-e068e31b2129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:48Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e63572-b91d-4fe9-bb11-83c3970da97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e63572-b91d-4fe9-bb11-83c3970da97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0df9d3b-93ae-4db7-ab12-d56871cb3d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0df9d3b-93ae-4db7-ab12-d56871cb3d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea9086b0-fb26-4e49-82e6-e068e31b2129', 'volume_name': 'volume-ea9086b0-fb26-4e49-82e6-e068e31b2129', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a26b86-94ce-4bc9-bfd2-69c48e6ae52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a26b86-94ce-4bc9-bfd2-69c48e6ae52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412107fb-1b90-4783-8f96-c981da8f0c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Volume ea9086b0-fb26-4e49-82e6-e068e31b2129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea9086b0-fb26-4e49-82e6-e068e31b2129', 'volume_size': 1} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:48 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89" returned: 0 in 1.026s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:48 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89 Jun 23 04:32:48 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (7ad4dedc-8d45-44aa-8d74-a6ff22192d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a48c2b-94e0-49d5-a137-fc7df5ae011b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a48c2b-94e0-49d5-a137-fc7df5ae011b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1126902802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dd6a32-1bfc-4c43-99aa-7148b3c684aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:48Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775aa73f-8c4e-48c2-8e76-8d6a98ba3d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (775aa73f-8c4e-48c2-8e76-8d6a98ba3d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3aebaa-f7a9-42d8-a74a-b070b9a57bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3aebaa-f7a9-42d8-a74a-b070b9a57bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98dd6a32-1bfc-4c43-99aa-7148b3c684aa', 'volume_name': 'volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d78789-25cc-4b73-937e-6f50cd861243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d78789-25cc-4b73-937e-6f50cd861243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc0f4a9-14fb-43a2-a440-a55c048e604e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Volume 98dd6a32-1bfc-4c43-99aa-7148b3c684aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa', 'volume_size': 1} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 1.529s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:48 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 Jun 23 04:32:48 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (8bf4c6ed-3fef-4e79-b08a-cdcd0d5db355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c88b4e-31f0-4fd7-8f52-ee2dc7048e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37c88b4e-31f0-4fd7-8f52-ee2dc7048e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-658492223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf3e1c4-cce6-4887-a9c5-44cc97a79fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:49Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9a55e9-9886-4451-a2a9-dd1a801726a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d9a55e9-9886-4451-a2a9-dd1a801726a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a0ecaf-0d9c-4b9b-8ee4-528853be20ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96a0ecaf-0d9c-4b9b-8ee4-528853be20ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adf3e1c4-cce6-4887-a9c5-44cc97a79fa2', 'volume_name': 'volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df12d8d-f92b-4c95-b3f3-c6279705abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df12d8d-f92b-4c95-b3f3-c6279705abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ebc0f3-d404-47e7-b12e-d0ecb98763e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Volume adf3e1c4-cce6-4887-a9c5-44cc97a79fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2', 'volume_size': 1} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:49 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eb863742-7ca9-4ce0-ac24-0e67a291bb89" returned: 0 in 1.191s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "cinder-quobyte-eb863742-7ca9-4ce0-ac24-0e67a291bb89" released by "delete_volume" :: held 2.268s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Created reservations ['3597e150-ef3e-4917-89c8-cf3d6192b8b1', '846cb822-90ff-4b3e-94dd-b8048b80c1b6', '85a557ba-098b-41d2-99c1-ed6329388568', '899feadc-76e9-4154-a858-d5c10f48805f'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (d5d43e64-5bc4-41f2-a057-2a109e993a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d091a077-75fe-464f-92b5-be0c9325d8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d091a077-75fe-464f-92b5-be0c9325d8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230915274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72c5e74-b844-4b49-a9c0-8a2cac1a97c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:49Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d650190-4642-4c0a-b39b-0b0260536970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d650190-4642-4c0a-b39b-0b0260536970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63b0ae3-4c4e-4253-8c58-c6c2e29b7407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63b0ae3-4c4e-4253-8c58-c6c2e29b7407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b72c5e74-b844-4b49-a9c0-8a2cac1a97c6', 'volume_name': 'volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2225f079-f99b-4e31-8e30-e6c8a7a49757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2225f079-f99b-4e31-8e30-e6c8a7a49757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07710ddf-871e-485d-aa99-c75124823d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Volume b72c5e74-b844-4b49-a9c0-8a2cac1a97c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6', 'volume_size': 1} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:49 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:32:49 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (9429d3ea-0015-41b3-a8a9-4338b3fa27a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f23c3fa-7f52-4bd5-8df2-f2e857c46e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f23c3fa-7f52-4bd5-8df2-f2e857c46e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849035500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2c2e25-ceda-4a1e-87d0-b086aae41536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:50Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab966d8-b76e-48a6-89ca-9a434027f345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab966d8-b76e-48a6-89ca-9a434027f345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b037ec5-a1b5-48d3-89f7-c7f1c4a0d02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b037ec5-a1b5-48d3-89f7-c7f1c4a0d02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce2c2e25-ceda-4a1e-87d0-b086aae41536', 'volume_name': 'volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2e2cfc-6c2b-40d4-bf6b-66fbfd3ed544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2e2cfc-6c2b-40d4-bf6b-66fbfd3ed544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00277f40-3caf-41e5-b7ee-70de46a93c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:50 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Volume ce2c2e25-ceda-4a1e-87d0-b086aae41536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536', 'volume_size': 1} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:50 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.135s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:32:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Deleted volume successfully. Jun 23 04:32:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0461a263-a1b7-46f6-879e-05c9431b9451 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "cinder-eb863742-7ca9-4ce0-ac24-0e67a291bb89-delete_volume" released by "delete_volume" :: held 3.814s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:32:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Flow 'volume_create_manager' (435b899a-64c9-4322-bddf-114347494934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b169194-3251-4ecb-b785-07b59a42b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b169194-3251-4ecb-b785-07b59a42b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-839721639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9d4399-b88d-412a-9b81-7f5018ea8b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d89a82c03d4bfdb815930b49a66588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:52Z,use_quota=True,user_id='8787a5470f324788ada4020cd7d9d1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eeb48a9-ea69-4c57-a18c-0d5e79858a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eeb48a9-ea69-4c57-a18c-0d5e79858a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb952716-f91a-40c7-9c98-ec58c22e1ff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb952716-f91a-40c7-9c98-ec58c22e1ff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9d4399-b88d-412a-9b81-7f5018ea8b98', 'volume_name': 'volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606ef32f-9cfa-49f9-8e81-9f3ec37d9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606ef32f-9cfa-49f9-8e81-9f3ec37d9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61a5e97-60f4-4289-a887-5ce4e0675a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Volume 2d9d4399-b88d-412a-9b81-7f5018ea8b98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98', 'volume_size': 1} Jun 23 04:32:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:54 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85" returned: 0 in 5.402s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7dffac-f615-400a-8972-f787c5327b75]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:54 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:32:54 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:54 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:32:54 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:55 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.697s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:32:55 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 0.980s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713, size 1024.00 MB, duration 5.40 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:32:55 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Converted 1024.00 MB image at 189.49 MB/s Jun 23 04:32:55 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 is being set with open permissions: ugo+rw Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:55 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 Jun 23 04:32:55 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:55 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85" returned: 0 in 0.641s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-72b82844-fc87-4692-b9c2-847901507e85" released by "_copy_volume_from_snapshot" :: held 9.511s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9cbc2811-7e67-4a34-b172-9cefcf36982f-72b82844-fc87-4692-b9c2-847901507e85" released by "_create_volume_from_snapshot" :: held 9.559s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.594s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.936s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2049646458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea9086b0-fb26-4e49-82e6-e068e31b2129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:48Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Creating volume ea9086b0-fb26-4e49-82e6-e068e31b2129 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:56 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:56 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 1073741824 Jun 23 04:32:56 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ff2b89-5481-477e-b953-56ec0c71ed9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b82844-fc87-4692-b9c2-847901507e85', 'volume_size': 2, 'snapshot_id': '9cbc2811-7e67-4a34-b172-9cefcf36982f'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101847c-f1eb-4127-b4c2-86f560c7e1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:56 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Volume volume-72b82844-fc87-4692-b9c2-847901507e85 (72b82844-fc87-4692-b9c2-847901507e85): created successfully Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a101847c-f1eb-4127-b4c2-86f560c7e1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (c67028f6-d744-4df0-9632-3982e1ab033e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a892db83-ae0e-4a8b-a10f-875cba18f281 tempest-VolumesSnapshotTestJSON-413637895 None] Created volume successfully. Jun 23 04:32:56 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 1073741824" returned: 0 in 0.819s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:56 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 Jun 23 04:32:56 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-72b82844-fc87-4692-b9c2-847901507e85-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-72b82844-fc87-4692-b9c2-847901507e85-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-72b82844-fc87-4692-b9c2-847901507e85" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-72b82844-fc87-4692-b9c2-847901507e85" acquired by "delete_volume" :: waited 0.013s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7341f170-e190-4970-9c51-3424206f93da]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:57 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 Jun 23 04:32:57 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:57 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129" returned: 0 in 0.658s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.625s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1126902802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98dd6a32-1bfc-4c43-99aa-7148b3c684aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:48Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Creating volume 98dd6a32-1bfc-4c43-99aa-7148b3c684aa {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:57 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:57 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa 1073741824 Jun 23 04:32:57 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (412107fb-1b90-4783-8f96-c981da8f0c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea9086b0-fb26-4e49-82e6-e068e31b2129', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6d101d-c159-466b-8ee1-8d2b36722ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:57 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Volume volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 (ea9086b0-fb26-4e49-82e6-e068e31b2129): created successfully Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6d101d-c159-466b-8ee1-8d2b36722ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (aaa8e5b5-d8fa-45d2-aaff-02e922b5b089) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:57 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-52dc17bf-15da-4557-aba4-80e6c4a68d21 tempest-CreateVolumesFromImageTest-826230777 None] Created volume successfully. Jun 23 04:32:57 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85" returned: 0 in 0.841s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:57 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85 Jun 23 04:32:57 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:58 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa 1073741824" returned: 0 in 0.897s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:58 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa Jun 23 04:32:58 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:58 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-72b82844-fc87-4692-b9c2-847901507e85" returned: 0 in 0.697s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-72b82844-fc87-4692-b9c2-847901507e85" released by "delete_volume" :: held 1.583s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['f9b7e8ed-7134-4783-913c-d48a87866b5c', '8f81fe8f-a537-4e05-b43b-8f70e1f60663', 'da54e71f-1ecb-4128-b6e7-22db2f4240a2', '58210b83-b4ec-443a-a05d-2620d68135cf'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:58 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:32:58 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:59 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.054s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-658492223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adf3e1c4-cce6-4887-a9c5-44cc97a79fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:49Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Creating volume adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:32:59 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-9cbc2811-7e67-4a34-b172-9cefcf36982f-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:59 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 1073741824 Jun 23 04:32:59 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc0f4a9-14fb-43a2-a440-a55c048e604e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f8ffc8-2b2c-4911-99f8-6b0e64366bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-9cbc2811-7e67-4a34-b172-9cefcf36982f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-b6a2276b-2824-4297-9e87-8798869e3713" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:59 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Volume volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa (98dd6a32-1bfc-4c43-99aa-7148b3c684aa): created successfully Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f8ffc8-2b2c-4911-99f8-6b0e64366bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (7ad4dedc-8d45-44aa-8d74-a6ff22192d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-b6a2276b-2824-4297-9e87-8798869e3713" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-9cbc2811-7e67-4a34-b172-9cefcf36982f" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:32:59 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4fc97b06-a0ec-4230-a090-9b52c4ede32e tempest-CreateVolumesFromImageTest-826230777 None] Created volume successfully. Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9cbc2811-7e67-4a34-b172-9cefcf36982f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Deleting offline snapshot 9cbc2811-7e67-4a34-b172-9cefcf36982f of volume b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] snapshot_file for this snap is: volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b167d34-7cdd-4d05-ad5b-dadc8f7c8a28]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:32:59 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.732s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:32:59 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Deleted volume successfully. Jun 23 04:32:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-ead56c59-eb7a-4158-be3b-dbaa54b197e3 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-72b82844-fc87-4692-b9c2-847901507e85-delete_volume" released by "delete_volume" :: held 2.517s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:32:59 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f Jun 23 04:32:59 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:00 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 1073741824" returned: 0 in 0.976s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:00 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 Jun 23 04:33:00 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:00 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f" returned: 0 in 0.894s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6a2276b-2824-4297-9e87-8798869e3713(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4a7ef4-b085-4d6b-8e69-0f40f8d6305e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:00 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:33:00 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:00 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2" returned: 0 in 0.686s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.235s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-230915274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b72c5e74-b844-4b49-a9c0-8a2cac1a97c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:49Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Creating volume b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:00 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:00 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 1073741824 Jun 23 04:33:00 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ebc0f3-d404-47e7-b12e-d0ecb98763e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d13ed7-d259-4a8c-a5b4-f5774397a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Volume volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 (adf3e1c4-cce6-4887-a9c5-44cc97a79fa2): created successfully Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74d13ed7-d259-4a8c-a5b4-f5774397a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (8bf4c6ed-3fef-4e79-b08a-cdcd0d5db355) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-71760006-903d-435a-bdf9-6c2e36d2b2f2 tempest-CreateVolumesFromImageTest-826230777 None] Created volume successfully. Jun 23 04:33:01 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 0.786s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:01 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f Jun 23 04:33:01 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:01 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 1073741824" returned: 0 in 0.880s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:01 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f" returned: 0 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:01 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 Jun 23 04:33:01 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:01 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f Jun 23 04:33:01 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:02 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.197s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-849035500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce2c2e25-ceda-4a1e-87d0-b086aae41536,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='483fc64314e4424499e7148a8b235683',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:50Z,use_quota=True,user_id='44b06f457b554b0188174752d90ea15b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Creating volume ce2c2e25-ceda-4a1e-87d0-b086aae41536 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:02 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:02 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713.9cbc2811-7e67-4a34-b172-9cefcf36982f" returned: 0 in 0.687s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:02 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 1073741824 Jun 23 04:33:02 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07710ddf-871e-485d-aa99-c75124823d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253c8d5b-0fdf-49d1-91b1-089565469f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:02 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Volume volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 (b72c5e74-b844-4b49-a9c0-8a2cac1a97c6): created successfully Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253c8d5b-0fdf-49d1-91b1-089565469f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (d5d43e64-5bc4-41f2-a057-2a109e993a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9cbc2811-7e67-4a34-b172-9cefcf36982f" released by "_delete_snapshot" :: held 3.278s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d7cda435-fc0c-4a88-bcd5-bde88951fbd6 tempest-CreateVolumesFromImageTest-826230777 None] Created volume successfully. Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-b6a2276b-2824-4297-9e87-8798869e3713" released by "delete_snapshot" :: held 3.326s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['3c82b126-d8c3-498c-a8a6-1521130422de', '297a11ae-42d0-49f9-8b62-90b35ffd687b', '195a8f64-9249-4315-9ba5-f49c4325e415', 'a095d8b2-6e34-4744-967e-9a5af35da726'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Delete snapshot completed successfully. Jun 23 04:33:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f124891-9255-4ed4-afea-5705a48c68c6 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-9cbc2811-7e67-4a34-b172-9cefcf36982f-delete_snapshot" released by "delete_snapshot" :: held 3.490s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:03 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 1073741824" returned: 0 in 0.834s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:03 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 Jun 23 04:33:03 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-b6a2276b-2824-4297-9e87-8798869e3713-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-b6a2276b-2824-4297-9e87-8798869e3713-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-b6a2276b-2824-4297-9e87-8798869e3713" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-b6a2276b-2824-4297-9e87-8798869e3713" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[de695f5d-1c0f-4576-b895-05994690a3cf]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:03 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:33:03 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:04 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536" returned: 0 in 0.646s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.908s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:32:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-839721639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9d4399-b88d-412a-9b81-7f5018ea8b98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34d89a82c03d4bfdb815930b49a66588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:32:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:32:52Z,use_quota=True,user_id='8787a5470f324788ada4020cd7d9d1cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Creating volume 2d9d4399-b88d-412a-9b81-7f5018ea8b98 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:04 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:04 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 1073741824 Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00277f40-3caf-41e5-b7ee-70de46a93c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:04 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b9dc6b-2de3-45df-9382-869e80c53885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:04 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Volume volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 (ce2c2e25-ceda-4a1e-87d0-b086aae41536): created successfully Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b9dc6b-2de3-45df-9382-869e80c53885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Flow 'volume_create_manager' (9429d3ea-0015-41b3-a8a9-4338b3fa27a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7f0c5648-823f-4064-82c5-926133f37bad tempest-CreateVolumesFromImageTest-826230777 None] Created volume successfully. Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-ce2c2e25-ceda-4a1e-87d0-b086aae41536-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-ce2c2e25-ceda-4a1e-87d0-b086aae41536-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-quobyte-ce2c2e25-ceda-4a1e-87d0-b086aae41536" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-ce2c2e25-ceda-4a1e-87d0-b086aae41536" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:04 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 0.794s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b505424-5e4a-424c-aced-6006d950d6ef]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:04 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713 Jun 23 04:33:04 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:04 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 Jun 23 04:33:04 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:04 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 1073741824" returned: 0 in 0.910s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:04 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 Jun 23 04:33:05 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:05 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b6a2276b-2824-4297-9e87-8798869e3713" returned: 0 in 0.716s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-b6a2276b-2824-4297-9e87-8798869e3713" released by "delete_volume" :: held 1.576s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['feb2b48f-f0bf-41f1-a2ae-ed6fc38d297a', 'b3db7d83-7723-47fa-b758-03554fd5129e', '32f29367-6160-481e-aa38-54a6028e5b8b', 'dec173b5-9a2a-43bb-bcdc-0647659fdbc7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:05 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536" returned: 0 in 0.834s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:05 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536 Jun 23 04:33:05 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:05 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:05 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:05 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98" returned: 0 in 0.711s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.495s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61a5e97-60f4-4289-a887-5ce4e0675a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a441e2a-8763-4016-9a53-ee71ce497a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99273bd-fc6e-40c5-98d4-0f6e6e9e0b77]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:05 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Volume volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 (2d9d4399-b88d-412a-9b81-7f5018ea8b98): created successfully Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a441e2a-8763-4016-9a53-ee71ce497a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Flow 'volume_create_manager' (435b899a-64c9-4322-bddf-114347494934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-03b0d15e-4d04-4cbd-b998-1ff76b610482 tempest-VolumeQuotasAdminTestJSON-960456075 None] Created volume successfully. Jun 23 04:33:05 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 Jun 23 04:33:05 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:06 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:06 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.707s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ce2c2e25-ceda-4a1e-87d0-b086aae41536" returned: 0 in 0.761s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Deleted volume successfully. Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-ce2c2e25-ceda-4a1e-87d0-b086aae41536" released by "delete_volume" :: held 1.650s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c257ab0-b90c-490c-bf4c-02eb971fb9ef tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-b6a2276b-2824-4297-9e87-8798869e3713-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Created reservations ['8cc5759b-3ab1-40c0-bd45-c61fba86906f', '5f160f2e-27f6-4785-a654-1653b19bd146', '95eb403a-1dc8-415b-b145-3aaf130bc073', '1639cf9d-109e-45c7-aa42-d9d4ebebbf71'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:06 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:06 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (db3aa632-9f04-4ab4-8980-41b010658ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4354cd-ca01-407e-b249-aeca1f906100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4354cd-ca01-407e-b249-aeca1f906100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1668440853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c3a3af-83a2-4f34-9d47-c01a228025cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:06Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1fba7c-6971-4ad8-95e8-f9a7c87bf71b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1fba7c-6971-4ad8-95e8-f9a7c87bf71b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd69f807-b76a-42d6-bad8-09c5d0e7e7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd69f807-b76a-42d6-bad8-09c5d0e7e7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09c3a3af-83a2-4f34-9d47-c01a228025cf', 'volume_name': 'volume-09c3a3af-83a2-4f34-9d47-c01a228025cf', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49f40ad-d5ef-4999-ac1a-97f8ca7c2e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e49f40ad-d5ef-4999-ac1a-97f8ca7c2e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bfe80d-78a9-464b-b72f-0672865a9cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Volume 09c3a3af-83a2-4f34-9d47-c01a228025cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09c3a3af-83a2-4f34-9d47-c01a228025cf', 'volume_size': 1} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:06 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" returned: 0 in 0.865s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.896s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1668440853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09c3a3af-83a2-4f34-9d47-c01a228025cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:06Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Creating volume 09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:06 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:06 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf 1073741824 Jun 23 04:33:06 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31dac7fe-97bb-491c-a8a7-3c7499c411fe', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-7d761b8b-f2e0-414e-a103-b9ff51ae1112 req-5ef52ef2-967d-45ee-b5b3-ec5ce62caa3e tempest-TestServerVolumeAttachmentScenario-1038202881 None] attachment_update completed successfully. Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-quobyte-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a9eeac-5947-4e22-bafc-04142e875b12]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:07 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 Jun 23 04:33:07 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:07 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.797s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Deleted volume successfully. Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e11c6f1-7362-4695-83eb-534d9f540531 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-ce2c2e25-ceda-4a1e-87d0-b086aae41536-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:07 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf 1073741824" returned: 0 in 1.063s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:07 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:07 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-de24391a-8be4-44dc-87b2-f55bb464935d tempest-VolumeQuotasAdminTestJSON-1579213864 None] Transfer volume completed successfully. Jun 23 04:33:07 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6" returned: 0 in 0.991s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:07 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6 Jun 23 04:33:07 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:08 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.705s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69bfe80d-78a9-464b-b72f-0672865a9cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09c3a3af-83a2-4f34-9d47-c01a228025cf', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3329e4b-efcd-4285-a50a-50286f220b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:08 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Volume volume-09c3a3af-83a2-4f34-9d47-c01a228025cf (09c3a3af-83a2-4f34-9d47-c01a228025cf): created successfully Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3329e4b-efcd-4285-a50a-50286f220b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (db3aa632-9f04-4ab4-8980-41b010658ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cbf046f9-31be-43ea-9f81-9ffcdf3783c7 tempest-VolumesSnapshotTestJSON-413637895 None] Created volume successfully. Jun 23 04:33:08 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6" returned: 0 in 0.760s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6" released by "delete_volume" :: held 1.801s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Created reservations ['0d415b22-f3ac-4d04-99f2-e66d78e8ee08', '2a4ad646-0ffc-4223-8e89-dfa642b48f1c', '1bbe6714-c943-4bfc-ac8f-dae97233e3bc', 'f4a6a0de-9fab-4f40-9d44-e0b5feddf915'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Acquiring lock "cinder-2d9d4399-b88d-412a-9b81-7f5018ea8b98-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:08 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:08 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Lock "cinder-2d9d4399-b88d-412a-9b81-7f5018ea8b98-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Acquiring lock "cinder-quobyte-2d9d4399-b88d-412a-9b81-7f5018ea8b98" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Creating offline snapshot 3fb09478-f256-49ae-99fb-058b0a162033 of volume 09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Lock "cinder-quobyte-2d9d4399-b88d-412a-9b81-7f5018ea8b98" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[843e8462-5db1-4493-ae8c-0a743bd703b9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[688a4cde-a454-4c97-a039-cba184b88ec2]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-quobyte-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:09 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:09 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4786da56-51b1-4016-9471-bcb3382543fd]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:09 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 Jun 23 04:33:09 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:09 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 Jun 23 04:33:09 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:09 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.807s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Deleted volume successfully. Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-530c9100-3c45-46cd-86ee-aa38e37a3fe9 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-b72c5e74-b844-4b49-a9c0-8a2cac1a97c6-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:09 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.822s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:09 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 1G Jun 23 04:33:09 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:09 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98" returned: 0 in 0.896s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:09 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98 Jun 23 04:33:09 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:10 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2" returned: 0 in 0.873s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:10 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2 Jun 23 04:33:10 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:10 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2d9d4399-b88d-412a-9b81-7f5018ea8b98" returned: 0 in 0.700s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Lock "cinder-quobyte-2d9d4399-b88d-412a-9b81-7f5018ea8b98" released by "delete_volume" :: held 1.654s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Created reservations ['1d71d717-868a-4df8-9031-dc4770d86ce4', '2c47ab3f-ac36-4e2f-ac63-d709110ca258', '5bc3f5b2-8e31-47b9-a0d2-0c61a585c1a7', '26319537-722d-45c8-a618-d32f9fc2437b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:10 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:10 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2" returned: 0 in 0.675s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 1G" returned: 0 in 0.891s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c3a3af-83a2-4f34-9d47-c01a228025cf -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2" released by "delete_volume" :: held 1.619s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:10 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c3a3af-83a2-4f34-9d47-c01a228025cf -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 Jun 23 04:33:10 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Created reservations ['1ae2f1e8-3264-4352-a7fb-47b3b463d808', '020a177d-c9cd-41d0-805d-8bb8ba0c0391', 'ad945d42-8fe8-4caa-b448-d7bfe9771eb7', '13de214b-01e7-4247-8818-08f673dca977'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:10 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:10 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:10 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:10 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-98dd6a32-1bfc-4c43-99aa-7148b3c684aa-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-98dd6a32-1bfc-4c43-99aa-7148b3c684aa-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-quobyte-98dd6a32-1bfc-4c43-99aa-7148b3c684aa" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-98dd6a32-1bfc-4c43-99aa-7148b3c684aa" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[99aa3c16-973f-4b20-a6c6-120711999394]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:11 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09c3a3af-83a2-4f34-9d47-c01a228025cf -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033" returned: 0 in 0.952s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:11 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 is being set with open permissions: ugo+rw Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:11 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa Jun 23 04:33:11 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:11 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 Jun 23 04:33:11 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:11 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.924s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Deleted volume successfully. Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8e13033c-f9ae-4171-b3bc-9a5caf110588 tempest-VolumeQuotasAdminTestJSON-1321103857 None] Lock "cinder-2d9d4399-b88d-412a-9b81-7f5018ea8b98-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:11 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.953s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Deleted volume successfully. Jun 23 04:33:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46174a9c-f2cc-463e-a4f0-254f3108cd56 tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-adf3e1c4-cce6-4887-a9c5-44cc97a79fa2-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:12 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033" returned: 0 in 0.843s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:12 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa" returned: 0 in 1.080s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:12 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa Jun 23 04:33:12 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:12 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info Jun 23 04:33:12 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info" returned: 0 in 0.714s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:13 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info is being set with open permissions: ugo+rw Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-98dd6a32-1bfc-4c43-99aa-7148b3c684aa" returned: 0 in 0.762s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:13 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:13 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:13 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info Jun 23 04:33:13 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-98dd6a32-1bfc-4c43-99aa-7148b3c684aa" released by "delete_volume" :: held 1.920s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Created reservations ['eb20cf97-675e-49d4-9b64-7f7d1c29f167', '61d17c7d-019c-46e0-8907-a18e057d29c3', 'f288071d-3ace-473a-afe6-12650935c24a', '12194483-eb81-46bd-afcb-96c47503504a'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:13 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:13 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-ea9086b0-fb26-4e49-82e6-e068e31b2129-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-ea9086b0-fb26-4e49-82e6-e068e31b2129-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "cinder-quobyte-ea9086b0-fb26-4e49-82e6-e068e31b2129" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-ea9086b0-fb26-4e49-82e6-e068e31b2129" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf5bc0e-7e43-415f-91ef-1aa607f1b047]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:14 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 Jun 23 04:33:14 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:14 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.info" returned: 0 in 1.073s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.466s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b62305ac-a588-463c-a5e2-04d7653dfff5 tempest-VolumesSnapshotTestJSON-413637895 None] Create snapshot completed successfully Jun 23 04:33:14 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.047s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Deleted volume successfully. Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c3608d48-e4d8-4c16-9188-660a34321dbb tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-98dd6a32-1bfc-4c43-99aa-7148b3c684aa-delete_volume" released by "delete_volume" :: held 3.370s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:14 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129" returned: 0 in 1.013s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:15 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129 Jun 23 04:33:15 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:15 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ea9086b0-fb26-4e49-82e6-e068e31b2129" returned: 0 in 0.877s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-quobyte-ea9086b0-fb26-4e49-82e6-e068e31b2129" released by "delete_volume" :: held 1.960s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (e2505233-1ed3-4421-ae92-e35a9129056e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e7583e-2da7-41e1-8274-f7754cef3e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06e7583e-2da7-41e1-8274-f7754cef3e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-8857787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d75bd64-2690-4929-82be-73b08c32ef36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1d31c2d21114b598021f86fd6daded8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3fb09478-f256-49ae-99fb-058b0a162033,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:16Z,use_quota=True,user_id='9c44a1bd6ce443999de2b867a320cefc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac354b4-8ed2-4abb-85ee-be3cf89bc154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac354b4-8ed2-4abb-85ee-be3cf89bc154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc94b77e-3b4b-4caf-8d60-e26538b1a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc94b77e-3b4b-4caf-8d60-e26538b1a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9d75bd64-2690-4929-82be-73b08c32ef36', 'volume_name': 'volume-9d75bd64-2690-4929-82be-73b08c32ef36', 'volume_size': 1, 'snapshot_id': '3fb09478-f256-49ae-99fb-058b0a162033'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3848ec05-e1aa-46b5-90cd-84fcb806d389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3848ec05-e1aa-46b5-90cd-84fcb806d389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e61892-fb3b-4097-90fb-2b0d0e5f624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Volume 9d75bd64-2690-4929-82be-73b08c32ef36: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9d75bd64-2690-4929-82be-73b08c32ef36', 'volume_size': 1, 'snapshot_id': '3fb09478-f256-49ae-99fb-058b0a162033'} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-3fb09478-f256-49ae-99fb-058b0a162033-9d75bd64-2690-4929-82be-73b08c32ef36" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Created reservations ['0176b9f2-1221-4fb9-98e4-b98b88510e58', 'f97ae77a-123d-4189-bf75-6bb10d52a977', '606fcd6e-f812-42fe-b018-fd70d4ece7cd', '5e50ceb4-8d44-4a75-bd5b-66d8f6863ba6'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-3fb09478-f256-49ae-99fb-058b0a162033-9d75bd64-2690-4929-82be-73b08c32ef36" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Creating volume 9d75bd64-2690-4929-82be-73b08c32ef36 from snapshot 3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-9d75bd64-2690-4929-82be-73b08c32ef36" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9d75bd64-2690-4929-82be-73b08c32ef36" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] snapshot: 3fb09478-f256-49ae-99fb-058b0a162033, volume: 9d75bd64-2690-4929-82be-73b08c32ef36, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[41511291-83cd-4e75-b12b-dc8b6045296d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:16 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:16 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:16 devstack sudo[107713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 Jun 23 04:33:16 devstack sudo[107713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:17 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.762s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Deleted volume successfully. Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-480ebfde-9a33-41d3-97c5-7089a04d5f6e tempest-CreateVolumesFromImageTest-826230777 None] Lock "cinder-ea9086b0-fb26-4e49-82e6-e068e31b2129-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:17 devstack sudo[107713]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033" returned: 0 in 0.960s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c3a3af-83a2-4f34-9d47-c01a228025cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee27dc1-7efc-4669-b388-267412353b15]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:17 devstack sudo[107729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:17 devstack sudo[107729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:18 devstack sudo[107729]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.848s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:18 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:33:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:18 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 Jun 23 04:33:18 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Flow 'volume_create_manager' (ffe907c6-792e-45ab-ad1d-3b8596daef9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2315d917-35cb-4da9-8b6e-3dceec1c4d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2315d917-35cb-4da9-8b6e-3dceec1c4d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1950294004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49cfa19-7a9f-4664-bd9d-37f304e2065f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8be970ead6ce46038a00d5a086e1795f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:21Z,use_quota=True,user_id='478ddae8ba994bef8bf19f9bbb4557dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358adfec-3a59-428c-80c4-26c7cf6a6852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358adfec-3a59-428c-80c4-26c7cf6a6852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3946fc7-1756-4790-8e08-f016b945f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3946fc7-1756-4790-8e08-f016b945f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a49cfa19-7a9f-4664-bd9d-37f304e2065f', 'volume_name': 'volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3a520e-d2bd-46c5-860c-7eaa6e85f0f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf3a520e-d2bd-46c5-860c-7eaa6e85f0f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1662b881-0533-457b-8a6c-0e75f174e59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:21 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Volume a49cfa19-7a9f-4664-bd9d-37f304e2065f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f', 'volume_size': 1} Jun 23 04:33:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:23 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36" returned: 0 in 5.244s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:23 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5bc091-5088-4df8-a9cd-e97591e03a65]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:23 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:23 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:24 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.924s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:33:24 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Converted 1024.00 MB image at 195.24 MB/s Jun 23 04:33:24 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 is being set with open permissions: ugo+rw Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:24 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 Jun 23 04:33:24 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:24 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36" returned: 0 in 0.640s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9d75bd64-2690-4929-82be-73b08c32ef36" released by "_copy_volume_from_snapshot" :: held 8.735s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-3fb09478-f256-49ae-99fb-058b0a162033-9d75bd64-2690-4929-82be-73b08c32ef36" released by "_create_volume_from_snapshot" :: held 8.779s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.805s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.761s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dde52f-aaf1-44f4-b85f-eeb4e7ce923a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8e61892-fb3b-4097-90fb-2b0d0e5f624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d75bd64-2690-4929-82be-73b08c32ef36', 'volume_size': 1, 'snapshot_id': '3fb09478-f256-49ae-99fb-058b0a162033'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5ec544-2d11-421b-8df6-e27cdaf5532a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:24 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Volume volume-9d75bd64-2690-4929-82be-73b08c32ef36 (9d75bd64-2690-4929-82be-73b08c32ef36): created successfully Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d5ec544-2d11-421b-8df6-e27cdaf5532a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Flow 'volume_create_manager' (e2505233-1ed3-4421-ae92-e35a9129056e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0eb2ffe3-bba7-457f-8e1a-9fb94817e962 tempest-VolumesSnapshotTestJSON-413637895 None] Created volume successfully. Jun 23 04:33:25 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 Jun 23 04:33:25 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:25 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0" returned: 0 in 0.753s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.772s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.171s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1950294004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a49cfa19-7a9f-4664-bd9d-37f304e2065f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8be970ead6ce46038a00d5a086e1795f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:21Z,use_quota=True,user_id='478ddae8ba994bef8bf19f9bbb4557dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Creating volume a49cfa19-7a9f-4664-bd9d-37f304e2065f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:25 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=114,cinder:UPDATE=131,cinder:INSERT=29,cinder:DELETE=11 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=101,cinder:UPDATE=126,cinder:INSERT=31,cinder:DELETE=13 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:33:25 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f 1073741824 Jun 23 04:33:25 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20e8b275-236c-45dd-8770-acc8cf085ef0', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-9d75bd64-2690-4929-82be-73b08c32ef36-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:25 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-c6c8d777-7df3-4a4e-a662-b432b35ad351 req-f266a4dc-bf13-4afa-a307-fbe2c9307f2f tempest-TestServerVolumeAttachmentScenario-1038202881 None] attachment_update completed successfully. Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-9d75bd64-2690-4929-82be-73b08c32ef36-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-9d75bd64-2690-4929-82be-73b08c32ef36" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9d75bd64-2690-4929-82be-73b08c32ef36" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[280ec74a-da4f-4ebf-bd04-0e6426dc69a0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:26 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 Jun 23 04:33:26 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:26 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f 1073741824" returned: 0 in 0.867s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:26 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f Jun 23 04:33:26 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:26 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36" returned: 0 in 0.792s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:26 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36 Jun 23 04:33:26 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:27 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f" returned: 0 in 0.680s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.598s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1662b881-0533-457b-8a6c-0e75f174e59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595a042f-24e7-4c22-a14a-180b2da8b1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:27 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Volume volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f (a49cfa19-7a9f-4664-bd9d-37f304e2065f): created successfully Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (595a042f-24e7-4c22-a14a-180b2da8b1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Flow 'volume_create_manager' (ffe907c6-792e-45ab-ad1d-3b8596daef9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:27 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9872415f-347d-4118-b06d-8d6c6e6187f0 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Created volume successfully. Jun 23 04:33:27 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-9d75bd64-2690-4929-82be-73b08c32ef36" returned: 0 in 0.678s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-9d75bd64-2690-4929-82be-73b08c32ef36" released by "delete_volume" :: held 1.517s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['8b71c7e8-5969-4dc8-929d-642b32a617f2', '2db42731-0238-4f1b-9057-8013bd17558a', 'a1554520-3a60-496c-8026-f408de0d22df', '9d45845b-6024-4c3b-8195-2c48d1606172'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:27 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:27 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-3fb09478-f256-49ae-99fb-058b0a162033-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:28 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.690s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-3fb09478-f256-49ae-99fb-058b0a162033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-09c3a3af-83a2-4f34-9d47-c01a228025cf" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Deleted volume successfully. Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-09c3a3af-83a2-4f34-9d47-c01a228025cf" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-3fb09478-f256-49ae-99fb-058b0a162033" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a5ddc827-0723-4067-8c55-de54b9a54f50 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-9d75bd64-2690-4929-82be-73b08c32ef36-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-3fb09478-f256-49ae-99fb-058b0a162033" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Deleting offline snapshot 3fb09478-f256-49ae-99fb-058b0a162033 of volume 09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] snapshot_file for this snap is: volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c301b4c-bdf8-4d33-852e-e1ff93b93b78]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:28 devstack sudo[107823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 Jun 23 04:33:28 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Acquiring lock "cinder-a49cfa19-7a9f-4664-bd9d-37f304e2065f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "cinder-a49cfa19-7a9f-4664-bd9d-37f304e2065f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Acquiring lock "cinder-quobyte-a49cfa19-7a9f-4664-bd9d-37f304e2065f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "cinder-quobyte-a49cfa19-7a9f-4664-bd9d-37f304e2065f" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[891c7f68-4770-4af9-8902-70594badc2b7]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:28 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f Jun 23 04:33:28 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:29 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033" returned: 0 in 0.783s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09c3a3af-83a2-4f34-9d47-c01a228025cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[36148a00-42ff-4a43-9e67-a878eb10682e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:29 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:29 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:29 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f" returned: 0 in 0.823s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:29 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f Jun 23 04:33:29 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:29 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.818s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:29 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 Jun 23 04:33:29 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:30 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a49cfa19-7a9f-4664-bd9d-37f304e2065f" returned: 0 in 0.767s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "cinder-quobyte-a49cfa19-7a9f-4664-bd9d-37f304e2065f" released by "delete_volume" :: held 1.645s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Created reservations ['6c30a98c-6298-40ae-b38c-343e6afa910c', 'e15f62fd-2b48-4382-af3f-04e82d0da75d', 'a9735f38-3517-4b95-afe3-839f10006b20', '5a862d9d-a05d-44a8-b734-0d3ce702dc14'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:30 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:30 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:30 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033" returned: 0 in 0.936s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:30 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033 Jun 23 04:33:30 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:31 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Deleted volume successfully. Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1b9332c7-d360-4148-8572-e6c8608d8997 tempest-VolumeQuotasNegativeTestJSON-1103828084 None] Lock "cinder-a49cfa19-7a9f-4664-bd9d-37f304e2065f-delete_volume" released by "delete_volume" :: held 2.715s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:31 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf.3fb09478-f256-49ae-99fb-058b0a162033" returned: 0 in 0.737s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-3fb09478-f256-49ae-99fb-058b0a162033" released by "_delete_snapshot" :: held 3.383s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-09c3a3af-83a2-4f34-9d47-c01a228025cf" released by "delete_snapshot" :: held 3.406s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['f33bffff-dec3-4179-81f8-36a94192b7cd', 'fdce40a9-3591-4991-940b-6abdae6b9257', '595bab23-db9b-4f98-bf73-904df505c5b9', '1d310171-b9bf-45a5-9aff-c908fc8a6cdb'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Delete snapshot completed successfully. Jun 23 04:33:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-99fcd534-2fad-4bd9-899b-df1847800f85 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-3fb09478-f256-49ae-99fb-058b0a162033-delete_snapshot" released by "delete_snapshot" :: held 3.641s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-b18ab0bd-93b6-472f-bb14-ec18f047c641 req-67f18087-9bfd-4f89-8c99-2c42a7f98a14 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Terminate volume connection completed successfully. Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-b18ab0bd-93b6-472f-bb14-ec18f047c641 req-67f18087-9bfd-4f89-8c99-2c42a7f98a14 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Deleting attachment 20e8b275-236c-45dd-8770-acc8cf085ef0. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-09c3a3af-83a2-4f34-9d47-c01a228025cf-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-09c3a3af-83a2-4f34-9d47-c01a228025cf-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-09c3a3af-83a2-4f34-9d47-c01a228025cf" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-09c3a3af-83a2-4f34-9d47-c01a228025cf" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aa3f12-b41e-47a1-a277-ea50b2d4db60]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:32 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:32 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:33 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.807s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:33 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf Jun 23 04:33:33 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:34 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-09c3a3af-83a2-4f34-9d47-c01a228025cf" returned: 0 in 0.780s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-09c3a3af-83a2-4f34-9d47-c01a228025cf" released by "delete_volume" :: held 1.661s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['15c6ba12-c855-43c5-8dbe-cf9cf76285a7', 'ba5e0912-d298-4f64-b7fb-0e6d74fd3e03', 'eaa03d1d-d655-4c7a-b92f-cfc1e87f0092', 'e7cf1c92-6ca8-4ca4-9807-dbc6969e6e70'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:34 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:34 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-ff804844-ecc2-4be9-9682-7a0ce6797d1f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-ff804844-ecc2-4be9-9682-7a0ce6797d1f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "cinder-quobyte-ff804844-ecc2-4be9-9682-7a0ce6797d1f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-ff804844-ecc2-4be9-9682-7a0ce6797d1f" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b7b6cb-4649-4ff2-b4d5-ed69e6610770]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:35 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f Jun 23 04:33:35 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:35 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.718s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:35 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Deleted volume successfully. Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-64b5a22e-cf2c-4e9e-9572-482640118a38 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-09c3a3af-83a2-4f34-9d47-c01a228025cf-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:35 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f" returned: 0 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:35 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f Jun 23 04:33:35 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:36 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-075f1cc3-0476-4157-965b-846bb942710e req-c643b009-30f0-407f-b2c0-28eb5172ca6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Terminate volume connection completed successfully. Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-075f1cc3-0476-4157-965b-846bb942710e req-c643b009-30f0-407f-b2c0-28eb5172ca6c tempest-TestServerVolumeAttachmentScenario-1038202881 None] Deleting attachment 31dac7fe-97bb-491c-a8a7-3c7499c411fe. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:33:36 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ff804844-ecc2-4be9-9682-7a0ce6797d1f" returned: 0 in 0.723s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-quobyte-ff804844-ecc2-4be9-9682-7a0ce6797d1f" released by "delete_volume" :: held 1.698s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Flow 'volume_create_manager' (6115c90b-6f85-4f99-94b2-1dda5899ef39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c97011-c869-4b07-8046-835bff4b6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c97011-c869-4b07-8046-835bff4b6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1209903315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20a97be-9962-4e3e-bac6-72cb70ff1de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b187588833f24a7b92f497a3587e0cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:37Z,use_quota=True,user_id='ffd0b3b4c39f4950a074a47e98e94bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11d7a14b-a314-4988-b80e-755883420bb9),volume_type_id=11d7a14b-a314-4988-b80e-755883420bb9)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c9675f-f1cd-4ee5-af32-8462217b311c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c9675f-f1cd-4ee5-af32-8462217b311c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b035f85-e323-4940-8ac1-0a5e1606a74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b035f85-e323-4940-8ac1-0a5e1606a74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20a97be-9962-4e3e-bac6-72cb70ff1de3', 'volume_name': 'volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96c743e-13d9-4771-a21c-5dcd364cd861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c96c743e-13d9-4771-a21c-5dcd364cd861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1262960d-0f04-478c-bb22-fef3757ab142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:36 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Volume d20a97be-9962-4e3e-bac6-72cb70ff1de3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3', 'volume_size': 1} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1209903315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20a97be-9962-4e3e-bac6-72cb70ff1de3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b187588833f24a7b92f497a3587e0cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:37Z,use_quota=True,user_id='ffd0b3b4c39f4950a074a47e98e94bee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11d7a14b-a314-4988-b80e-755883420bb9),volume_type_id=11d7a14b-a314-4988-b80e-755883420bb9)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Creating volume d20a97be-9962-4e3e-bac6-72cb70ff1de3 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:36 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:36 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 1073741824 Jun 23 04:33:36 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Created reservations ['52fc6f2e-8688-4acf-a432-0d38a3ebbedd', '337d0bd1-0bcf-4c97-b8fa-12c842b4464e', '3b3887b5-c6fe-45b2-a636-b39693b2dc11', 'a8ab4162-8afb-4b57-b978-40de981ffd25'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:36 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:36 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:37 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.730s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:37 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Deleted volume successfully. Jun 23 04:33:37 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 1073741824" returned: 0 in 0.894s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e7325e4e-27a6-4563-a539-d18bd57db234 tempest-VolumesSnapshotTestJSON-413637895 None] Lock "cinder-ff804844-ecc2-4be9-9682-7a0ce6797d1f-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:37 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 Jun 23 04:33:37 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:38 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3" returned: 0 in 0.760s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1262960d-0f04-478c-bb22-fef3757ab142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16e3225-a63d-46cb-bb5d-0ec8b3895d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:38 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Volume volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 (d20a97be-9962-4e3e-bac6-72cb70ff1de3): created successfully Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f16e3225-a63d-46cb-bb5d-0ec8b3895d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Flow 'volume_create_manager' (6115c90b-6f85-4f99-94b2-1dda5899ef39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8a3f506d-529b-484f-a46a-2edefd8cefb8 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Created volume successfully. Jun 23 04:33:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:39 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:39 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:40 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.945s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:40 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ebb10e67-359d-47d2-bf42-bec92066072e tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Retype volume completed successfully. Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Acquiring lock "cinder-d20a97be-9962-4e3e-bac6-72cb70ff1de3-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "cinder-d20a97be-9962-4e3e-bac6-72cb70ff1de3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Acquiring lock "cinder-quobyte-d20a97be-9962-4e3e-bac6-72cb70ff1de3" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "cinder-quobyte-d20a97be-9962-4e3e-bac6-72cb70ff1de3" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffc21ed-8844-47e2-a99e-2fd5328264cd]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:40 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 Jun 23 04:33:40 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:41 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3" returned: 0 in 0.949s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:41 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3 Jun 23 04:33:41 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:42 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d20a97be-9962-4e3e-bac6-72cb70ff1de3" returned: 0 in 0.823s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "cinder-quobyte-d20a97be-9962-4e3e-bac6-72cb70ff1de3" released by "delete_volume" :: held 1.827s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:33:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Created reservations ['c8ee6b1d-7838-42aa-971f-e0825c6ba244', '07ddc057-c832-4eec-bdec-801046d65ee2', '7a20fa35-1576-4de2-bc81-2b066f2e4c1d', '11857c0c-8a24-466f-ae3e-f54b8f18f9b4'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:42 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:42 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:43 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Deleted volume successfully. Jun 23 04:33:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-01c8e1e5-c935-419d-adca-c276ff7f8312 tempest-VolumeRetypeWithoutMigrationTest-1863296965 None] Lock "cinder-d20a97be-9962-4e3e-bac6-72cb70ff1de3-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Flow 'volume_create_manager' (0a3c1224-4301-48d0-8cf7-1de0063f1dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745edfa2-18ff-4355-ae8d-94cbba12a389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745edfa2-18ff-4355-ae8d-94cbba12a389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-200214354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed8277c-97da-45c1-977c-0f6eca7e030c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54baed730ffa4076921be46ecfb444d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:44Z,use_quota=True,user_id='bccedbba6af940ab818007eaa8d46b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50c6d21-a2b5-480a-9239-dc79430e0421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f50c6d21-a2b5-480a-9239-dc79430e0421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd0e02f-5ad8-497e-9a04-e9c2b5f5b02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dd0e02f-5ad8-497e-9a04-e9c2b5f5b02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed8277c-97da-45c1-977c-0f6eca7e030c', 'volume_name': 'volume-eed8277c-97da-45c1-977c-0f6eca7e030c', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460f5da-248a-450a-897b-ff825b911895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b460f5da-248a-450a-897b-ff825b911895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274a3b45-939f-4636-bd31-5cfcddde8046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Volume eed8277c-97da-45c1-977c-0f6eca7e030c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed8277c-97da-45c1-977c-0f6eca7e030c', 'volume_size': 1} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:33:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-200214354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed8277c-97da-45c1-977c-0f6eca7e030c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54baed730ffa4076921be46ecfb444d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:33:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:33:44Z,use_quota=True,user_id='bccedbba6af940ab818007eaa8d46b57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Creating volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:33:44 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:33:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:44 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c 1073741824 Jun 23 04:33:44 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:45 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c 1073741824" returned: 0 in 0.938s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:45 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c Jun 23 04:33:45 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:46 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] <== create_volume: return (1687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (274a3b45-939f-4636-bd31-5cfcddde8046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed8277c-97da-45c1-977c-0f6eca7e030c', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec1bffd-2384-4087-8b43-afe99a27c562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:33:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Volume volume-eed8277c-97da-45c1-977c-0f6eca7e030c (eed8277c-97da-45c1-977c-0f6eca7e030c): created successfully Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ec1bffd-2384-4087-8b43-afe99a27c562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Flow 'volume_create_manager' (0a3c1224-4301-48d0-8cf7-1de0063f1dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-fc9d618e-f98e-4230-8806-03d88f802d58 tempest-VolumesSnapshotListTestJSON-348566123 None] Created volume successfully. Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Creating offline snapshot 52192f4e-5261-4f45-abfd-9f172001b183 of volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0296432-5298-44c0-9d41-5466d424e7a8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:47 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c Jun 23 04:33:47 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "cinder-35156b5d-8dc3-4057-8fb1-9d029f509ab0-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-35156b5d-8dc3-4057-8fb1-9d029f509ab0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "cinder-quobyte-35156b5d-8dc3-4057-8fb1-9d029f509ab0" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-quobyte-35156b5d-8dc3-4057-8fb1-9d029f509ab0" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24ddf88-d9fa-453e-826e-8b71da6e97c2]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:47 devstack sudo[107984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 Jun 23 04:33:47 devstack sudo[107984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:47 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c" returned: 0 in 0.939s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:47 devstack sudo[107989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 1G Jun 23 04:33:47 devstack sudo[107989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:48 devstack sudo[107984]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0" returned: 0 in 0.811s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:48 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0 Jun 23 04:33:48 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:48 devstack sudo[107989]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 1G" returned: 0 in 0.861s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:48 devstack sudo[108000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:33:48 devstack sudo[108000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:48 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-35156b5d-8dc3-4057-8fb1-9d029f509ab0" returned: 0 in 0.710s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-quobyte-35156b5d-8dc3-4057-8fb1-9d029f509ab0" released by "delete_volume" :: held 1.570s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Created reservations ['90a9a99a-7178-44d5-810f-8a37263ec8d8', '552049c1-ad36-4803-a100-f64f3649e63e', 'aad6f52b-c0ac-42ad-80ba-d3458df2a430', '3768510d-95f1-49ec-9b15-ecf5b3ac0595'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:49 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:49 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:49 devstack sudo[108000]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:49 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 is being set with open permissions: ugo+rw Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:49 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:33:49 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "cinder-f7d6cb09-df24-4c66-b13e-1f2c4ca81812-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-f7d6cb09-df24-4c66-b13e-1f2c4ca81812-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "cinder-quobyte-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-quobyte-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af076a9-2ae1-4e7c-8bf1-f67b0057c659]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:49 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 Jun 23 04:33:49 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:49 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.860s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:49 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Deleted volume successfully. Jun 23 04:33:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-09f43181-c09d-47ef-8362-a5ce002d946f tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-35156b5d-8dc3-4057-8fb1-9d029f509ab0-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:50 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.849s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:50 devstack sudo[108014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info Jun 23 04:33:50 devstack sudo[108014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:50 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" returned: 0 in 0.928s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:50 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812 Jun 23 04:33:50 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:51 devstack sudo[108014]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:51 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info is being set with open permissions: ugo+rw Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:51 devstack sudo[108022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info Jun 23 04:33:51 devstack sudo[108022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:51 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" returned: 0 in 0.717s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-quobyte-f7d6cb09-df24-4c66-b13e-1f2c4ca81812" released by "delete_volume" :: held 1.701s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Created reservations ['9f000220-2e7f-4d45-877f-27eaa5c9d09e', 'ee7e033a-4003-4f2b-a382-41918ec37585', 'ce7b2e46-87a3-49ae-9867-48881d6da692', '2970b0cf-dc07-4a59-80f7-10d0f7f3eb0f'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:51 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:51 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:51 devstack sudo[108022]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.info" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.914s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9e44dffc-2112-4408-b8a8-f6d18675dad1 tempest-VolumesSnapshotListTestJSON-348566123 None] Create snapshot completed successfully Jun 23 04:33:52 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.705s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Deleted volume successfully. Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a3a74df9-4c0a-4b38-bd65-47c981747bc3 tempest-TestServerVolumeAttachmentScenario-1038202881 None] Lock "cinder-f7d6cb09-df24-4c66-b13e-1f2c4ca81812-delete_volume" released by "delete_volume" :: held 2.662s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Creating offline snapshot 6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 of volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6465c3e1-cafe-485c-9efb-5efb5b4282ba]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:52 devstack sudo[108029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:33:52 devstack sudo[108029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:53 devstack sudo[108029]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.883s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:33:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:53 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 1G Jun 23 04:33:53 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:54 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 1G" returned: 0 in 1.001s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:54 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:33:54 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:54 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:33:54 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:55 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 1.016s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:55 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 is being set with open permissions: ugo+rw Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:55 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:33:55 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:55 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.024s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:33:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:33:56 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 0.824s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.874s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:33:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e69474e5-8264-4904-a311-41ab827c890d tempest-VolumesSnapshotListTestJSON-348566123 None] Create snapshot completed successfully Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Creating offline snapshot 4e273964-c427-4781-9c73-41aee5da6dad of volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b2a1b-ec83-48f2-83fd-d21a1017363e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:33:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:57 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:33:57 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:57 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 0.865s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:33:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:57 devstack sudo[108060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad 1G Jun 23 04:33:57 devstack sudo[108060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:58 devstack sudo[108060]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad 1G" returned: 0 in 0.991s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:58 devstack sudo[108067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad Jun 23 04:33:58 devstack sudo[108067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:59 devstack sudo[108067]: pam_unix(sudo:session): session closed for user root Jun 23 04:33:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad" returned: 0 in 0.843s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:33:59 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad is being set with open permissions: ugo+rw Jun 23 04:33:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:33:59 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad Jun 23 04:33:59 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:33:59 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:33:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Flow 'volume_create_manager' (31d44796-21cb-496a-a936-f86beac3e6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:33:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74d5818-fb6c-48ad-870d-78c58b62b313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74d5818-fb6c-48ad-870d-78c58b62b313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-593649151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf802b97524af0a78bb1dc173d2c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:00Z,use_quota=True,user_id='d11783647d6f47a5862d941b0315ac68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35626ed-d63f-487d-b7c4-be08c49ba3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b35626ed-d63f-487d-b7c4-be08c49ba3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95a1120-ca03-4449-b151-02c27c7ea40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95a1120-ca03-4449-b151-02c27c7ea40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a', 'volume_name': 'volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768aff10-4281-40d0-89c7-0fd3924b2277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768aff10-4281-40d0-89c7-0fd3924b2277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd749a6-deba-4429-95eb-edb1ad24eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Volume f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a', 'volume_size': 1} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:00 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad" returned: 0 in 0.835s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.641s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.459s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-593649151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf802b97524af0a78bb1dc173d2c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:00Z,use_quota=True,user_id='d11783647d6f47a5862d941b0315ac68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Creating volume f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:00 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:00 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a 1073741824 Jun 23 04:34:00 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-673f79fa-cec4-4ad4-9b3b-b7cf57d9f623 tempest-VolumesSnapshotListTestJSON-348566123 None] Create snapshot completed successfully Jun 23 04:34:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a 1073741824" returned: 0 in 0.987s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:01 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:01 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a Jun 23 04:34:01 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-4e273964-c427-4781-9c73-41aee5da6dad-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-4e273964-c427-4781-9c73-41aee5da6dad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-4e273964-c427-4781-9c73-41aee5da6dad" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-4e273964-c427-4781-9c73-41aee5da6dad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Deleting offline snapshot 4e273964-c427-4781-9c73-41aee5da6dad of volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] snapshot_file for this snap is: volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c208d1-832c-4473-b4bd-d422fdb9fd20]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:02 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad Jun 23 04:34:02 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:02 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a" returned: 0 in 0.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fd749a6-deba-4429-95eb-edb1ad24eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63efb17d-5b15-4995-83d4-6721b6d4e179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:02 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Volume volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a (f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a): created successfully Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63efb17d-5b15-4995-83d4-6721b6d4e179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Flow 'volume_create_manager' (31d44796-21cb-496a-a936-f86beac3e6db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-bf59625d-5dda-480b-92f1-8da369506932 tempest-VolumesListAdminTestJSON-1713239528 None] Created volume successfully. Jun 23 04:34:02 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad" returned: 0 in 0.839s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b47c92e-beda-491f-9d2d-423d3586c600]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:03 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:34:03 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Flow 'volume_create_manager' (137a26cd-29da-45ca-8f03-2921cc2f066a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a225ba68-677c-40cd-b81d-57dad6756a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a225ba68-677c-40cd-b81d-57dad6756a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-936002869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf802b97524af0a78bb1dc173d2c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:04Z,use_quota=True,user_id='d11783647d6f47a5862d941b0315ac68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca1516-794d-4649-b191-c457a8633ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70ca1516-794d-4649-b191-c457a8633ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6973264-939e-45de-9c6c-7bcc5c77ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6973264-939e-45de-9c6c-7bcc5c77ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc', 'volume_name': 'volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7031b86-b8e2-4e58-a94c-b4a2ceba220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7031b86-b8e2-4e58-a94c-b4a2ceba220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caad5dd4-0f41-495b-8bc5-9ff5ee01670f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:03 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Volume 2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc', 'volume_size': 1} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-936002869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf802b97524af0a78bb1dc173d2c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:04Z,use_quota=True,user_id='d11783647d6f47a5862d941b0315ac68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Creating volume 2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:03 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:03 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc 1073741824 Jun 23 04:34:03 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:03 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 0.840s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:03 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad Jun 23 04:34:03 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (8086039f-0d80-48b7-9855-1dcfd2d7c446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bada0ea-3d14-4147-97e6-3ad40bd57c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bada0ea-3d14-4147-97e6-3ad40bd57c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949530632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200e09e6-6915-4242-bded-a13e97540c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:04Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01143d15-ad96-494e-b79f-b28cbb09c35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01143d15-ad96-494e-b79f-b28cbb09c35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cc6989-b4fb-4504-ac1e-9e8f5d5651c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cc6989-b4fb-4504-ac1e-9e8f5d5651c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '200e09e6-6915-4242-bded-a13e97540c47', 'volume_name': 'volume-200e09e6-6915-4242-bded-a13e97540c47', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db370f2-3f13-4bd8-874d-f1c57b6775bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db370f2-3f13-4bd8-874d-f1c57b6775bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b671c519-bf66-4e98-9ba4-a338f6fa6de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:04 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume 200e09e6-6915-4242-bded-a13e97540c47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-200e09e6-6915-4242-bded-a13e97540c47', 'volume_size': 1} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:04 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc 1073741824" returned: 0 in 0.894s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:04 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad" returned: 0 in 0.847s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:04 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc Jun 23 04:34:04 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:04 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad Jun 23 04:34:04 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:05 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc" returned: 0 in 0.639s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.578s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.117s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-949530632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=200e09e6-6915-4242-bded-a13e97540c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:04Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating volume 200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:05 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:05 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caad5dd4-0f41-495b-8bc5-9ff5ee01670f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:05 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 1073741824 Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0312c4a0-f77b-4dfb-836e-5bbe13cefcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:05 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.4e273964-c427-4781-9c73-41aee5da6dad" returned: 0 in 0.673s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-4e273964-c427-4781-9c73-41aee5da6dad" released by "_delete_snapshot" :: held 3.343s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:05 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Volume volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc (2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc): created successfully Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0312c4a0-f77b-4dfb-836e-5bbe13cefcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Flow 'volume_create_manager' (137a26cd-29da-45ca-8f03-2921cc2f066a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" released by "delete_snapshot" :: held 3.383s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f73bead7-a206-4c79-a8f1-ed7e3df4814b tempest-VolumesListAdminTestJSON-1713239528 None] Created volume successfully. Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Created reservations ['45cf00db-2430-4777-a1c2-a352ec937d7e', '72db387c-b379-4e4b-83c5-00193949edfa', '6d67a063-e418-452b-8e46-4c45ec4a00b9', '0e9178fa-0ce5-4fed-a44a-87bb002b2a14'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Delete snapshot completed successfully. Jun 23 04:34:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-21b703b2-4103-4a05-9e5f-605044787939 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-4e273964-c427-4781-9c73-41aee5da6dad-delete_snapshot" released by "delete_snapshot" :: held 3.524s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-6e9f65ca-f7ae-4708-8e88-852b5a86cfd7-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Flow 'volume_create_manager' (07ed6b52-37a1-4c4b-b7fd-bec32616e160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:06 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcf1178-83f5-4d1b-b6e1-7241371c912d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 1073741824" returned: 0 in 0.944s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcf1178-83f5-4d1b-b6e1-7241371c912d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-250448239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bf9dee-13ad-4f13-9698-c441d57a761f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf802b97524af0a78bb1dc173d2c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:06Z,use_quota=True,user_id='d11783647d6f47a5862d941b0315ac68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798c6d0a-3322-4ee5-bbf1-ce4840d95032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798c6d0a-3322-4ee5-bbf1-ce4840d95032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7090b569-2376-4d53-ae8f-e233cf0f1153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7090b569-2376-4d53-ae8f-e233cf0f1153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9bf9dee-13ad-4f13-9698-c441d57a761f', 'volume_name': 'volume-c9bf9dee-13ad-4f13-9698-c441d57a761f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd897da-ed16-4904-bfe7-5bdaca7cb8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cd897da-ed16-4904-bfe7-5bdaca7cb8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bde13c-9f6c-42fe-856f-8a375aa3b527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Volume c9bf9dee-13ad-4f13-9698-c441d57a761f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9bf9dee-13ad-4f13-9698-c441d57a761f', 'volume_size': 1} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-6e9f65ca-f7ae-4708-8e88-852b5a86cfd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Deleting offline snapshot 6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 of volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:34:06 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 Jun 23 04:34:06 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] snapshot_file for this snap is: volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3dd9c0-9e82-49a2-8679-6c7ba576d15b]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:06 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:34:06 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:07 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47" returned: 0 in 0.657s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.709s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.704s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-250448239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9bf9dee-13ad-4f13-9698-c441d57a761f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf802b97524af0a78bb1dc173d2c53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:06Z,use_quota=True,user_id='d11783647d6f47a5862d941b0315ac68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Creating volume c9bf9dee-13ad-4f13-9698-c441d57a761f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:07 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:07 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f 1073741824 Jun 23 04:34:07 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b671c519-bf66-4e98-9ba4-a338f6fa6de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-200e09e6-6915-4242-bded-a13e97540c47', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b27314-72c5-446f-a4ac-f9a51914c585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:07 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume volume-200e09e6-6915-4242-bded-a13e97540c47 (200e09e6-6915-4242-bded-a13e97540c47): created successfully Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9b27314-72c5-446f-a4ac-f9a51914c585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (8086039f-0d80-48b7-9855-1dcfd2d7c446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ec479ae0-bdda-40ca-bc2e-aa5c1cba00c1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created volume successfully. Jun 23 04:34:07 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 0.851s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39e3c67-18ac-4cf9-816b-9f20c2baf5d8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:07 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:34:07 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:07 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f 1073741824" returned: 0 in 0.836s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:07 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f Jun 23 04:34:07 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:08 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.802s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:08 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:34:08 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:08 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f" returned: 0 in 0.644s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.090s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating offline snapshot a6812113-3260-4491-aaa5-d37eda90991d of volume 200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42bde13c-9f6c-42fe-856f-8a375aa3b527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9bf9dee-13ad-4f13-9698-c441d57a761f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38080600-8f25-418a-863d-4bdc36cf4c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f360fc83-c694-4a20-8139-7913fe5e95cf]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:08 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Volume volume-c9bf9dee-13ad-4f13-9698-c441d57a761f (c9bf9dee-13ad-4f13-9698-c441d57a761f): created successfully Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38080600-8f25-418a-863d-4bdc36cf4c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Flow 'volume_create_manager' (07ed6b52-37a1-4c4b-b7fd-bec32616e160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-da69310c-0cb3-4dff-8177-378571bf67db tempest-VolumesListAdminTestJSON-1713239528 None] Created volume successfully. Jun 23 04:34:08 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 Jun 23 04:34:08 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:08 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 0.820s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:08 devstack sudo[108186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7 Jun 23 04:34:08 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:09 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47" returned: 0 in 0.823s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:09 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d 1G Jun 23 04:34:09 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:09 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" returned: 0 in 0.686s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-6e9f65ca-f7ae-4708-8e88-852b5a86cfd7" released by "_delete_snapshot" :: held 3.274s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" released by "delete_snapshot" :: held 3.313s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Created reservations ['bf370fa8-d90a-4430-b8b4-d4b7128b5490', 'b6e44422-de2a-414a-8e0a-14be90c92ae6', '84294c46-678b-4a91-9c9a-6bfa73a8c284', 'bc8e0453-3201-4ef0-8f67-b37ea6c6d48e'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Delete snapshot completed successfully. Jun 23 04:34:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-224be878-44f4-4f38-81f1-da9a7c3a503a tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-6e9f65ca-f7ae-4708-8e88-852b5a86cfd7-delete_snapshot" released by "delete_snapshot" :: held 3.475s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Flow 'volume_create_manager' (f145949b-b7ad-4b95-9514-93614d1a28e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdac85d-03ea-48f2-8ac6-e31d79614c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdac85d-03ea-48f2-8ac6-e31d79614c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64884a95-f780-46ab-81fa-e43d28585c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da9e31062264c07b507d6641361211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:10Z,use_quota=True,user_id='9185ba2b56364debb4308d345343933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910ea08a-8771-4438-bffd-763cb39fd583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910ea08a-8771-4438-bffd-763cb39fd583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaaf573b-37e1-4252-9ba9-087b7ac481dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eaaf573b-37e1-4252-9ba9-087b7ac481dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64884a95-f780-46ab-81fa-e43d28585c67', 'volume_name': 'volume-64884a95-f780-46ab-81fa-e43d28585c67', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c57ad4-1e23-4cfe-b929-6e775e452bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62c57ad4-1e23-4cfe-b929-6e775e452bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a6ad51-1c7a-457a-92ec-90355e4cb884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:10 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Volume 64884a95-f780-46ab-81fa-e43d28585c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64884a95-f780-46ab-81fa-e43d28585c67', 'volume_size': 1} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:10 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d 1G" returned: 0 in 0.869s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-200e09e6-6915-4242-bded-a13e97540c47 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:10 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-200e09e6-6915-4242-bded-a13e97540c47 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d Jun 23 04:34:10 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-52192f4e-5261-4f45-abfd-9f172001b183-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-52192f4e-5261-4f45-abfd-9f172001b183-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-52192f4e-5261-4f45-abfd-9f172001b183" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-52192f4e-5261-4f45-abfd-9f172001b183" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Deleting offline snapshot 52192f4e-5261-4f45-abfd-9f172001b183 of volume eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] snapshot_file for this snap is: volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff489d16-5947-482d-993f-8f043d207deb]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:10 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:34:10 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:10 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-200e09e6-6915-4242-bded-a13e97540c47 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d" returned: 0 in 0.684s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:10 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d is being set with open permissions: ugo+rw Jun 23 04:34:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:11 devstack sudo[108204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d Jun 23 04:34:11 devstack sudo[108204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:11 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.778s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed8277c-97da-45c1-977c-0f6eca7e030c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:11 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c80b5ad-4389-47c1-a341-8c4f768d322a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:11 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c Jun 23 04:34:11 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:11 devstack sudo[108204]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d" returned: 0 in 0.635s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:11 devstack sudo[108212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info Jun 23 04:34:11 devstack sudo[108212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:12 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c" returned: 0 in 0.778s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:12 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:34:12 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:12 devstack sudo[108212]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info" returned: 0 in 0.693s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:12 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info is being set with open permissions: ugo+rw Jun 23 04:34:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:12 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info Jun 23 04:34:12 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:12 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.796s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:12 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183 Jun 23 04:34:12 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:13 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.info" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.465s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.766s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64884a95-f780-46ab-81fa-e43d28585c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da9e31062264c07b507d6641361211e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:10Z,use_quota=True,user_id='9185ba2b56364debb4308d345343933a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Creating volume 64884a95-f780-46ab-81fa-e43d28585c67 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:13 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:13 devstack sudo[108228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 1073741824 Jun 23 04:34:13 devstack sudo[108228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e8508d81-45aa-4f55-bef8-6d0e161c910f tempest-CreateVolumesFromSnapshotTest-789314568 None] Create snapshot completed successfully Jun 23 04:34:13 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c.52192f4e-5261-4f45-abfd-9f172001b183" returned: 0 in 0.680s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-52192f4e-5261-4f45-abfd-9f172001b183" released by "_delete_snapshot" :: held 3.145s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" released by "delete_snapshot" :: held 3.167s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Created reservations ['4d965b39-3c7f-4e82-a5e3-e1f0fd5ce70c', 'e7888773-fc29-4f4a-a743-a263e9a4fefa', 'a64a2682-b527-46ae-9650-2f3decfef79a', '0293a93d-a500-4911-8dd1-02ddd1283ec5'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Delete snapshot completed successfully. Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-11c27ef9-3f5b-4506-a415-357fa9cc27bb tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-52192f4e-5261-4f45-abfd-9f172001b183-delete_snapshot" released by "delete_snapshot" :: held 3.325s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:13 devstack sudo[108228]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 1073741824" returned: 0 in 0.910s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:14 devstack sudo[108235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 Jun 23 04:34:14 devstack sudo[108235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (d839005a-82eb-43e7-a00b-a083e3b0b35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf9773-bf48-4605-b74e-1d2fcf5cafc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf9773-bf48-4605-b74e-1d2fcf5cafc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896838271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74ea3e2-10a5-461f-8da2-f42c7b5cd129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:14Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e4ac4d-ad61-4b8f-80cd-c84069f4b988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e4ac4d-ad61-4b8f-80cd-c84069f4b988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc49690c-381f-43aa-8162-ac4373d56da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc49690c-381f-43aa-8162-ac4373d56da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74ea3e2-10a5-461f-8da2-f42c7b5cd129', 'volume_name': 'volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b5ec5f-d49c-4d2b-b684-1ea4b23630a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67b5ec5f-d49c-4d2b-b684-1ea4b23630a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07fb0e3-54de-4f8f-b8c1-1104ce52dba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume d74ea3e2-10a5-461f-8da2-f42c7b5cd129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129', 'volume_size': 1} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (9c6563eb-38e5-49dd-8121-fbf6916a04f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fd06aa-6585-4334-9f67-746a8c059286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72fd06aa-6585-4334-9f67-746a8c059286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-917516593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7398c89-9a4f-4806-a5cf-7515ec4ed59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:15Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa460fa-ddaa-480a-854c-9fd24892dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa460fa-ddaa-480a-854c-9fd24892dff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e59c69f-8833-4e1a-a2bb-6a609db74e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e59c69f-8833-4e1a-a2bb-6a609db74e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7398c89-9a4f-4806-a5cf-7515ec4ed59b', 'volume_name': 'volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a90700b-d14e-4013-b891-28545ae3ba7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a90700b-d14e-4013-b891-28545ae3ba7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7455149-36f0-498b-b510-7335e7fdfbc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume d7398c89-9a4f-4806-a5cf-7515ec4ed59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b', 'volume_size': 1} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:14 devstack sudo[108235]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67" returned: 0 in 0.725s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1896838271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74ea3e2-10a5-461f-8da2-f42c7b5cd129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:14Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating volume d74ea3e2-10a5-461f-8da2-f42c7b5cd129 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:14 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:14 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 1073741824 Jun 23 04:34:14 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4a6ad51-1c7a-457a-92ec-90355e4cb884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64884a95-f780-46ab-81fa-e43d28585c67', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ec3d98-ba49-44af-bbea-f5dfe53b5fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:14 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Volume volume-64884a95-f780-46ab-81fa-e43d28585c67 (64884a95-f780-46ab-81fa-e43d28585c67): created successfully Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00ec3d98-ba49-44af-bbea-f5dfe53b5fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Flow 'volume_create_manager' (f145949b-b7ad-4b95-9514-93614d1a28e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-411f4baa-9033-479b-af8e-359804bcfc61 tempest-VolumesListAdminTestJSON-2074722004 None] Created volume successfully. Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-eed8277c-97da-45c1-977c-0f6eca7e030c-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-eed8277c-97da-45c1-977c-0f6eca7e030c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba80f1c-0a4c-4bad-8fa4-67bc4c2ff141]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (b75b6b5f-73d4-4657-9821-1dc3d63c6291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e805672d-466b-4980-8867-bc877899425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e805672d-466b-4980-8867-bc877899425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1634880837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cc0c0e-6dca-469d-9698-6f91a4df4a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:15Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c016136-6eff-428d-a7b7-3b2f6fd018c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c016136-6eff-428d-a7b7-3b2f6fd018c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4265442-4235-4c58-95f9-4f4cf6bd7160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4265442-4235-4c58-95f9-4f4cf6bd7160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cc0c0e-6dca-469d-9698-6f91a4df4a15', 'volume_name': 'volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbcd291-bfe9-4feb-b892-aa2dc68f3fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbcd291-bfe9-4feb-b892-aa2dc68f3fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c Jun 23 04:34:15 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0220fbc-a2ab-445d-a143-b8a25f63e8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume 16cc0c0e-6dca-469d-9698-6f91a4df4a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15', 'volume_size': 1} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (ebf4c430-d2b8-4d8d-b71a-b8caf337e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e67bf9-a939-453c-b8de-7ac6e6a5de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1e67bf9-a939-453c-b8de-7ac6e6a5de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390772788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290778ea-eb3a-4f1a-bb39-28f8c1f71e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:15Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e11d20-b084-4d1b-867c-6d338a845acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e11d20-b084-4d1b-867c-6d338a845acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a392169b-0ac2-4b5a-9b3a-73743c45268c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a392169b-0ac2-4b5a-9b3a-73743c45268c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '290778ea-eb3a-4f1a-bb39-28f8c1f71e05', 'volume_name': 'volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d530ad5-254b-4203-93ef-924565ce026c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d530ad5-254b-4203-93ef-924565ce026c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0844d20-2cb3-4ee9-8a4a-423178d42ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume 290778ea-eb3a-4f1a-bb39-28f8c1f71e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05', 'volume_size': 1} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Acquiring lock "cinder-64884a95-f780-46ab-81fa-e43d28585c67-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Lock "cinder-64884a95-f780-46ab-81fa-e43d28585c67-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Acquiring lock "cinder-quobyte-64884a95-f780-46ab-81fa-e43d28585c67" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Lock "cinder-quobyte-64884a95-f780-46ab-81fa-e43d28585c67" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a546a13a-6da6-4632-9f25-e04f8e13eb57]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:16 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "cinder-c9bf9dee-13ad-4f13-9698-c441d57a761f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 1073741824" returned: 0 in 1.340s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:16 devstack sudo[108250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 Jun 23 04:34:16 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:16 devstack sudo[108250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c" returned: 0 in 1.055s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-c9bf9dee-13ad-4f13-9698-c441d57a761f-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:16 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:16 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (280b2a81-da00-459d-841d-e11915888d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d924df0-8ebe-4743-b9e8-a72eed163603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d924df0-8ebe-4743-b9e8-a72eed163603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657519985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293d5f25-4d38-4544-a564-e0f7f8e74016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:16Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d262f0-f128-482a-a3e0-fca02e300247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d262f0-f128-482a-a3e0-fca02e300247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c015cab5-5a4b-4bf1-a04d-8040296c3115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c015cab5-5a4b-4bf1-a04d-8040296c3115) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '293d5f25-4d38-4544-a564-e0f7f8e74016', 'volume_name': 'volume-293d5f25-4d38-4544-a564-e0f7f8e74016', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb47943-b3c9-4c67-aa5a-f3acad3f5a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7eb47943-b3c9-4c67-aa5a-f3acad3f5a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabca647-39ee-4c47-99d1-257e2b6a4ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume 293d5f25-4d38-4544-a564-e0f7f8e74016: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-293d5f25-4d38-4544-a564-e0f7f8e74016', 'volume_size': 1} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "cinder-quobyte-c9bf9dee-13ad-4f13-9698-c441d57a761f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-quobyte-c9bf9dee-13ad-4f13-9698-c441d57a761f" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:16 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 Jun 23 04:34:16 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9820d1-fad1-4b22-8484-92e05dc0a79d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:16 devstack sudo[108256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f Jun 23 04:34:16 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:16 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-eed8277c-97da-45c1-977c-0f6eca7e030c" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:16 devstack sudo[108250]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67" returned: 0 in 0.880s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-quobyte-eed8277c-97da-45c1-977c-0f6eca7e030c" released by "delete_volume" :: held 1.843s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:16 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67 Jun 23 04:34:16 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Created reservations ['c10c84b6-d3a4-4afc-a498-81702787fd80', '513a07e1-67c5-4736-80a7-4e7a26d5dcb1', 'e18f4726-feb5-439e-928a-d359710e4b69', '7777266d-c091-4ccb-953c-7fa1f7ee9c2e'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:16 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:16 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:17 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129" returned: 0 in 0.805s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] <== create_volume: return (2330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.391s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-917516593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7398c89-9a4f-4806-a5cf-7515ec4ed59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:15Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating volume d7398c89-9a4f-4806-a5cf-7515ec4ed59b {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:17 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:17 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b 1073741824 Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07fb0e3-54de-4f8f-b8c1-1104ce52dba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:17 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152f9f92-7e13-4928-98da-c6c6bddee15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 (d74ea3e2-10a5-461f-8da2-f42c7b5cd129): created successfully Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (152f9f92-7e13-4928-98da-c6c6bddee15e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (d839005a-82eb-43e7-a00b-a083e3b0b35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:17 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f" returned: 0 in 0.888s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d75e51b8-c96a-4911-ab97-313c6d0eaf8f tempest-CreateVolumesFromSnapshotTest-789314568 None] Created volume successfully. Jun 23 04:34:17 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f Jun 23 04:34:17 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:17 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-64884a95-f780-46ab-81fa-e43d28585c67" returned: 0 in 0.959s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Lock "cinder-quobyte-64884a95-f780-46ab-81fa-e43d28585c67" released by "delete_volume" :: held 1.909s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Created reservations ['82e6a816-92c8-46d9-bb2e-51cfd2e4a9d3', '550b406f-c9da-441b-96a0-0f8519365bce', '3cda09db-b08a-471a-ad55-97a5fa2384de', '8addfe41-dd59-4f6c-a408-3b85faef7fca'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:17 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.973s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Deleted volume successfully. Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-46658d8e-c45a-4b51-bbb5-1259d1a0b2f2 tempest-VolumesSnapshotListTestJSON-348566123 None] Lock "cinder-eed8277c-97da-45c1-977c-0f6eca7e030c-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:18 devstack sudo[108283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:18 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:18 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b 1073741824" returned: 0 in 1.044s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:18 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9bf9dee-13ad-4f13-9698-c441d57a761f" returned: 0 in 1.017s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:18 devstack sudo[108285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b Jun 23 04:34:18 devstack sudo[108285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-quobyte-c9bf9dee-13ad-4f13-9698-c441d57a761f" released by "delete_volume" :: held 1.963s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Created reservations ['0bad9967-e33e-4123-bedf-455f5e1731f7', '3a451156-d2f0-4fb5-9ba1-f2132ba773ac', '06ed64cd-c853-4494-94ac-ff2366fdbdbd', 'e9c3e461-4b35-46b2-a0da-042ddd637d19'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:18 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:18 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:18 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Deleted volume successfully. Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-52cc7f04-18c1-44b9-8815-31bea0ede33a tempest-VolumesListAdminTestJSON-2074722004 None] Lock "cinder-64884a95-f780-46ab-81fa-e43d28585c67-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:18 devstack sudo[108285]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b" returned: 0 in 0.803s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.793s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1634880837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cc0c0e-6dca-469d-9698-6f91a4df4a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:15Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating volume 16cc0c0e-6dca-469d-9698-6f91a4df4a15 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:18 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:19 devstack sudo[108292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 1073741824 Jun 23 04:34:19 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7455149-36f0-498b-b510-7335e7fdfbc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77749ca-ac69-4c21-8bba-cca658db2d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:19 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b (d7398c89-9a4f-4806-a5cf-7515ec4ed59b): created successfully Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e77749ca-ac69-4c21-8bba-cca658db2d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (9c6563eb-38e5-49dd-8121-fbf6916a04f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-95470d9f-95e4-4b12-a726-abb5fb520bc3 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created volume successfully. Jun 23 04:34:19 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.776s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Deleted volume successfully. Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3c3543b3-aa52-49ed-9976-a6fdd4153485 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-c9bf9dee-13ad-4f13-9698-c441d57a761f-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "cinder-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "cinder-quobyte-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-quobyte-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2870231-d27d-42d2-befe-ea66c504244b]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:19 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc Jun 23 04:34:19 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:19 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 1073741824" returned: 0 in 0.992s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:20 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 Jun 23 04:34:20 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:20 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc" returned: 0 in 0.918s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:20 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc Jun 23 04:34:20 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:20 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15" returned: 0 in 0.689s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.165s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1390772788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=290778ea-eb3a-4f1a-bb39-28f8c1f71e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:15Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating volume 290778ea-eb3a-4f1a-bb39-28f8c1f71e05 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:20 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:20 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 1073741824 Jun 23 04:34:20 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0220fbc-a2ab-445d-a143-b8a25f63e8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92681e05-c705-4178-9575-c1d8dabe613d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:20 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 (16cc0c0e-6dca-469d-9698-6f91a4df4a15): created successfully Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92681e05-c705-4178-9575-c1d8dabe613d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:20 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (b75b6b5f-73d4-4657-9821-1dc3d63c6291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-50fc59a2-b0d1-4d95-8dac-5dd07b898de0 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created volume successfully. Jun 23 04:34:21 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc" returned: 0 in 0.812s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-quobyte-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc" released by "delete_volume" :: held 1.777s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Created reservations ['df3b0867-ed76-4dda-bb7b-fe7bbe612b9e', '4ca1d122-4e0b-4fd4-af86-b9c4765e49c0', 'b2946b63-9731-4a4e-8d3d-9b6916e384c8', 'cdc5eefb-67ab-4c54-9c71-b33e6c5e9bc9'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:21 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:21 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:21 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 1073741824" returned: 0 in 1.085s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:21 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 Jun 23 04:34:21 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "cinder-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "cinder-quobyte-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-quobyte-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6fee6-610b-4f07-9ede-23b8f6437d27]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:22 devstack sudo[108321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a Jun 23 04:34:22 devstack sudo[108321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:22 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:22 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Deleted volume successfully. Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0b5c5a96-499d-4846-a190-e716a27ad0c3 tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-2fbda24b-d40f-4a03-8cf4-e673bbeb8ccc-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:22 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05" returned: 0 in 0.776s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.424s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-657519985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=293d5f25-4d38-4544-a564-e0f7f8e74016,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9983ffe16b4042c8b571d88a783476a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:16Z,use_quota=True,user_id='d9031d2d6813492b99e048737b4bf64a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Creating volume 293d5f25-4d38-4544-a564-e0f7f8e74016 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:22 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0844d20-2cb3-4ee9-8a4a-423178d42ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:22 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 1073741824 Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba805786-3064-4fb6-97a2-a125b203540e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:22 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:22 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 (290778ea-eb3a-4f1a-bb39-28f8c1f71e05): created successfully Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba805786-3064-4fb6-97a2-a125b203540e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (ebf4c430-d2b8-4d8d-b71a-b8caf337e63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:22 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f3c0f52b-eef7-48b8-99fd-36974faf6ecb tempest-CreateVolumesFromSnapshotTest-789314568 None] Created volume successfully. Jun 23 04:34:22 devstack sudo[108321]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a" returned: 0 in 0.906s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:23 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a Jun 23 04:34:23 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:23 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 1073741824" returned: 0 in 0.942s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:23 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a" returned: 0 in 0.688s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:23 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 Jun 23 04:34:23 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-quobyte-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a" released by "delete_volume" :: held 1.657s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Created reservations ['2edb324f-d07d-470b-a55b-2df7b7b3e580', 'ca6295a5-797d-488f-86e3-36ca1c000130', '77e0d4a1-553d-42ef-a8c3-193ccd4c6911', 'a5ae3058-941b-4a37-8390-216d55ff7e65'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:23 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:23 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:24 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016" returned: 0 in 0.837s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fabca647-39ee-4c47-99d1-257e2b6a4ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-293d5f25-4d38-4544-a564-e0f7f8e74016', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0f674a-7ece-485d-ab99-6c3bf48168f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:24 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Volume volume-293d5f25-4d38-4544-a564-e0f7f8e74016 (293d5f25-4d38-4544-a564-e0f7f8e74016): created successfully Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0f674a-7ece-485d-ab99-6c3bf48168f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Flow 'volume_create_manager' (280b2a81-da00-459d-841d-e11915888d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7b4356ec-4c9b-4c16-94f1-14f6367e7463 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created volume successfully. Jun 23 04:34:24 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.752s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Deleted volume successfully. Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-18b17474-c676-4368-9066-b29e6807ea2d tempest-VolumesListAdminTestJSON-1713239528 None] Lock "cinder-f1f7c35d-72ae-4cc5-ba77-bf2fdd8a436a-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-293d5f25-4d38-4544-a564-e0f7f8e74016-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-293d5f25-4d38-4544-a564-e0f7f8e74016-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-293d5f25-4d38-4544-a564-e0f7f8e74016" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-293d5f25-4d38-4544-a564-e0f7f8e74016" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[927c7ec6-031f-43c1-962f-5a029723f0a3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:25 devstack sudo[108343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 Jun 23 04:34:25 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:25 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016" returned: 0 in 0.938s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:26 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016 Jun 23 04:34:26 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:26 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-293d5f25-4d38-4544-a564-e0f7f8e74016" returned: 0 in 0.768s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-293d5f25-4d38-4544-a564-e0f7f8e74016" released by "delete_volume" :: held 1.777s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=141,cinder:UPDATE=168,cinder:INSERT=40,cinder:DELETE=14 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=169,cinder:SELECT=123,cinder:INSERT=39,cinder:DELETE=15 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['1172d6af-9e2a-44d1-8ea6-517476a03c59', 'e06a39b1-650b-4822-860d-6d549424a88f', 'a054724a-5087-4258-b50d-ad75ef034faf', '242a396c-2328-4d44-9324-ed111a3da48b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:27 devstack sudo[108351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:27 devstack sudo[108351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-290778ea-eb3a-4f1a-bb39-28f8c1f71e05-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-290778ea-eb3a-4f1a-bb39-28f8c1f71e05-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-290778ea-eb3a-4f1a-bb39-28f8c1f71e05" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-290778ea-eb3a-4f1a-bb39-28f8c1f71e05" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b319d1d-650a-4dbe-b3a5-de60c3d0fc89]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:27 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 Jun 23 04:34:27 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:27 devstack sudo[108351]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.918s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:27 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleted volume successfully. Jun 23 04:34:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-49aef504-d755-4c60-8c64-b434968476b1 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-293d5f25-4d38-4544-a564-e0f7f8e74016-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:28 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05" returned: 0 in 1.011s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:28 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05 Jun 23 04:34:28 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:29 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-290778ea-eb3a-4f1a-bb39-28f8c1f71e05" returned: 0 in 0.827s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-290778ea-eb3a-4f1a-bb39-28f8c1f71e05" released by "delete_volume" :: held 1.895s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['9431163f-0bce-4435-9e38-7acc8089b787', 'a9ef917a-2656-4241-ac98-76ddf9c637aa', '66debb9f-7148-4c2e-bb33-abd45e9673ce', '8c6e0733-5e37-450e-bc75-a9d078ced5e9'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:29 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:29 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-16cc0c0e-6dca-469d-9698-6f91a4df4a15-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-16cc0c0e-6dca-469d-9698-6f91a4df4a15-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Flow 'volume_create_manager' (b44350c8-ffed-47d1-821f-32f6dd6209ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5e651e-9dea-450e-9d41-c1dddb91f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5e651e-9dea-450e-9d41-c1dddb91f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1629987254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9239f23-1ce7-4016-84c6-0a8fb16b1000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c79d334f4e045c2adaab4e995fd4f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:30Z,use_quota=True,user_id='ef40a9fbe5514a208a819189c7ee5dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e57d8a-6432-4ff4-9c0d-b977e62233b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e57d8a-6432-4ff4-9c0d-b977e62233b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddcbeb7-e2c1-480d-be0b-458b4df9b6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cddcbeb7-e2c1-480d-be0b-458b4df9b6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9239f23-1ce7-4016-84c6-0a8fb16b1000', 'volume_name': 'volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123de7f6-1884-4690-95ed-e94c5a827df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123de7f6-1884-4690-95ed-e94c5a827df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27a1086-d9a2-4852-80a2-d4d7ecaab4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:29 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Volume c9239f23-1ce7-4016-84c6-0a8fb16b1000: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000', 'volume_size': 1} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1629987254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9239f23-1ce7-4016-84c6-0a8fb16b1000,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c79d334f4e045c2adaab4e995fd4f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:30Z,use_quota=True,user_id='ef40a9fbe5514a208a819189c7ee5dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Creating volume c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:29 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-16cc0c0e-6dca-469d-9698-6f91a4df4a15" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:29 devstack sudo[108368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 1073741824 Jun 23 04:34:29 devstack sudo[108368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-16cc0c0e-6dca-469d-9698-6f91a4df4a15" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69b0a7e-2911-4421-a3a0-7432c9b800e6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:29 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 Jun 23 04:34:29 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:30 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleted volume successfully. Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fa52bf36-d4b3-4606-b2c8-78e539548b30 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-290778ea-eb3a-4f1a-bb39-28f8c1f71e05-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:30 devstack sudo[108368]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 1073741824" returned: 0 in 0.934s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:30 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15" returned: 0 in 0.905s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:30 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 Jun 23 04:34:30 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:30 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15 Jun 23 04:34:30 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:31 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000" returned: 0 in 0.732s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.722s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:31 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-16cc0c0e-6dca-469d-9698-6f91a4df4a15" returned: 0 in 0.710s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27a1086-d9a2-4852-80a2-d4d7ecaab4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07103fd5-dffa-45ce-a241-b396bc3e64c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-16cc0c0e-6dca-469d-9698-6f91a4df4a15" released by "delete_volume" :: held 1.702s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:31 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Volume volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 (c9239f23-1ce7-4016-84c6-0a8fb16b1000): created successfully Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07103fd5-dffa-45ce-a241-b396bc3e64c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Flow 'volume_create_manager' (b44350c8-ffed-47d1-821f-32f6dd6209ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-34478808-2e74-4f9d-ae4b-ed982cf74402 tempest-VolumesDeleteCascade-1189080571 None] Created volume successfully. Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['c27b6b0e-3d85-45ff-ac07-4ebb29709bbd', '171e08f2-009d-4e97-b088-fa2d63f64e15', '0bb83f79-ef38-4ea8-9484-3ca11c380f46', '65cf6c18-a14d-46bf-b335-03072347e6d4'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:31 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:31 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-d7398c89-9a4f-4806-a5cf-7515ec4ed59b-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-d7398c89-9a4f-4806-a5cf-7515ec4ed59b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-d7398c89-9a4f-4806-a5cf-7515ec4ed59b" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Creating offline snapshot b32525bc-eb89-46a6-b695-46c1b0b335dc of volume c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-d7398c89-9a4f-4806-a5cf-7515ec4ed59b" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c78d370-8af8-405c-b9d8-deecf9b7baca]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[07631c16-513c-474d-a191-9f7972446625]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:32 devstack sudo[108390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b Jun 23 04:34:32 devstack sudo[108390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:32 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 Jun 23 04:34:32 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:32 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.837s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:32 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleted volume successfully. Jun 23 04:34:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f8e9a76a-a804-409c-90a7-8820e1dc474b tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-16cc0c0e-6dca-469d-9698-6f91a4df4a15-delete_volume" released by "delete_volume" :: held 2.932s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:33 devstack sudo[108390]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b" returned: 0 in 0.919s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:33 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b Jun 23 04:34:33 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:33 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000" returned: 0 in 1.026s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:33 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc 1G Jun 23 04:34:33 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:33 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d7398c89-9a4f-4806-a5cf-7515ec4ed59b" returned: 0 in 0.778s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-d7398c89-9a4f-4806-a5cf-7515ec4ed59b" released by "delete_volume" :: held 1.772s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['34772614-21a5-4dac-9ed5-2645782ed1f3', '98863727-8e91-4582-9513-df8d67611657', 'e2c8f98a-f73d-4952-92c8-215cc6043619', '0fc5f6e2-d35f-43d7-a3d0-e1d19e93984b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:34 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:34 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:34 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc 1G" returned: 0 in 1.052s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:34 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:34 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-d74ea3e2-10a5-461f-8da2-f42c7b5cd129-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-d74ea3e2-10a5-461f-8da2-f42c7b5cd129-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-d74ea3e2-10a5-461f-8da2-f42c7b5cd129" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-d74ea3e2-10a5-461f-8da2-f42c7b5cd129" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfae58a-d287-4bfe-9013-93298deb25d8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:34 devstack sudo[108413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 Jun 23 04:34:34 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:34 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:34 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleted volume successfully. Jun 23 04:34:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2ce27334-df64-431d-9fde-7309a2ef70ce tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-d7398c89-9a4f-4806-a5cf-7515ec4ed59b-delete_volume" released by "delete_volume" :: held 2.883s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:35 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 0.861s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:35 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc is being set with open permissions: ugo+rw Jun 23 04:34:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:35 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:35 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:35 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129" returned: 0 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:35 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129 Jun 23 04:34:35 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:35 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 0.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:35 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info Jun 23 04:34:35 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:36 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d74ea3e2-10a5-461f-8da2-f42c7b5cd129" returned: 0 in 0.719s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-d74ea3e2-10a5-461f-8da2-f42c7b5cd129" released by "delete_volume" :: held 1.686s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['08f3571e-d161-48c4-9aa2-508b16d77ab9', 'ab53ba0c-99cb-49fc-aa05-f513c6b78c42', 'edb62ff0-e004-4468-bbb7-9a46ff451063', '8547495a-0dc7-4f80-9762-11ed2de340b8'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:36 devstack sudo[108430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:36 devstack sudo[108430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:36 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info" returned: 0 in 0.723s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:36 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info is being set with open permissions: ugo+rw Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-a6812113-3260-4491-aaa5-d37eda90991d-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:36 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info Jun 23 04:34:36 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-a6812113-3260-4491-aaa5-d37eda90991d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-200e09e6-6915-4242-bded-a13e97540c47" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-200e09e6-6915-4242-bded-a13e97540c47" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-a6812113-3260-4491-aaa5-d37eda90991d" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-a6812113-3260-4491-aaa5-d37eda90991d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleting offline snapshot a6812113-3260-4491-aaa5-d37eda90991d of volume 200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] snapshot_file for this snap is: volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a56169-a585-4c21-88a8-f1f65bf3c6f0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:36 devstack sudo[108435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d Jun 23 04:34:36 devstack sudo[108435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:36 devstack sudo[108430]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:36 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:36 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleted volume successfully. Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a25cf8f9-3d30-43f1-b534-27eedb4160aa tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-d74ea3e2-10a5-461f-8da2-f42c7b5cd129-delete_volume" released by "delete_volume" :: held 2.721s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:37 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.info" returned: 0 in 0.788s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.349s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:37 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d54a9801-4cff-41cc-ae1e-b8eb984f5120 tempest-VolumesDeleteCascade-1189080571 None] Create snapshot completed successfully Jun 23 04:34:37 devstack sudo[108435]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d" returned: 0 in 0.872s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-200e09e6-6915-4242-bded-a13e97540c47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3dadfb5-0642-4d33-8e64-742c92b30dff]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:37 devstack sudo[108443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 Jun 23 04:34:37 devstack sudo[108443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:38 devstack sudo[108443]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47" returned: 0 in 0.862s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:38 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d Jun 23 04:34:38 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Creating offline snapshot 57c66789-783f-4c24-aa93-029780cdf9e7 of volume c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a8de6-2734-4e74-b4f0-abcac8c1026a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:38 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:38 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:39 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d" returned: 0 in 0.945s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:39 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d Jun 23 04:34:39 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:39 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 1.028s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:39 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 1G Jun 23 04:34:39 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:40 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47.a6812113-3260-4491-aaa5-d37eda90991d" returned: 0 in 0.875s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-a6812113-3260-4491-aaa5-d37eda90991d" released by "_delete_snapshot" :: held 3.716s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-200e09e6-6915-4242-bded-a13e97540c47" released by "delete_snapshot" :: held 3.751s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['d78ca62f-9540-4165-8c63-2da2697e2f7c', '3f8e90f1-e948-4fc3-a8de-07dd7386e2e9', 'ee9396a4-e5b2-4f00-bbd0-1d8cfb302acf', '72a5a99b-df7a-4eec-ba10-25b75fa28b77'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:40 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Delete snapshot completed successfully. Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-094594c6-276f-4b62-be48-e980b5471647 tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-a6812113-3260-4491-aaa5-d37eda90991d-delete_snapshot" released by "delete_snapshot" :: held 3.934s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:40 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 1G" returned: 0 in 1.053s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:40 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 Jun 23 04:34:40 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-200e09e6-6915-4242-bded-a13e97540c47-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-200e09e6-6915-4242-bded-a13e97540c47-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "cinder-quobyte-200e09e6-6915-4242-bded-a13e97540c47" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-200e09e6-6915-4242-bded-a13e97540c47" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:41 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d418fed-b8d3-492c-80c3-96743bd5f889]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:41 devstack sudo[108473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 Jun 23 04:34:41 devstack sudo[108473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:41 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7" returned: 0 in 0.874s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:41 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 is being set with open permissions: ugo+rw Jun 23 04:34:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:41 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 Jun 23 04:34:41 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:42 devstack sudo[108473]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47" returned: 0 in 1.050s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:42 devstack sudo[108485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47 Jun 23 04:34:42 devstack sudo[108485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:42 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7" returned: 0 in 1.072s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:42 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6c6e9c16-db41-46da-af08-632af7364788 tempest-VolumesDeleteCascade-1189080571 None] Create snapshot completed successfully Jun 23 04:34:42 devstack sudo[108485]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-200e09e6-6915-4242-bded-a13e97540c47" returned: 0 in 0.839s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-quobyte-200e09e6-6915-4242-bded-a13e97540c47" released by "delete_volume" :: held 1.974s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Created reservations ['0d20caef-f430-449e-9284-3aee325336e1', '89af907a-d4bb-420e-bb54-50920ea7d5b0', '488e5785-c5a0-42c2-a2b0-e91523e55893', '10ee57b1-053f-4083-8467-2239488ad4ea'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:43 devstack sudo[108495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:43 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:43 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.774s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Deleted volume successfully. Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-65f58114-e3b3-4b0b-87b1-e7c0c6e2c2df tempest-CreateVolumesFromSnapshotTest-789314568 None] Lock "cinder-200e09e6-6915-4242-bded-a13e97540c47-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-c9239f23-1ce7-4016-84c6-0a8fb16b1000-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-c9239f23-1ce7-4016-84c6-0a8fb16b1000-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Performing cascade delete. {{(pid=93326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-57c66789-783f-4c24-aa93-029780cdf9e7-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-57c66789-783f-4c24-aa93-029780cdf9e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-57c66789-783f-4c24-aa93-029780cdf9e7" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-57c66789-783f-4c24-aa93-029780cdf9e7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Deleting offline snapshot 57c66789-783f-4c24-aa93-029780cdf9e7 of volume c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] snapshot_file for this snap is: volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5e65ef-b71f-412d-966e-5df87315943f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:44 devstack sudo[108498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 Jun 23 04:34:44 devstack sudo[108498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:45 devstack sudo[108498]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7" returned: 0 in 0.958s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:45 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f814bfb-fa79-4e75-9171-785faa6be5a0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:45 devstack sudo[108504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:45 devstack sudo[108504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:46 devstack sudo[108504]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 0.914s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:46 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 Jun 23 04:34:46 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:47 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7" returned: 0 in 0.904s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:47 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7 Jun 23 04:34:47 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Flow 'volume_create_manager' (d00211b6-65f7-4403-a740-3b637d40f5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd3b10b-bb5b-4a65-8137-51e122653aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd3b10b-bb5b-4a65-8137-51e122653aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1803435320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4c3082-7a81-4b3f-a438-a6678d836d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04c1d24d7714c468ca63211174b2a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:47Z,use_quota=True,user_id='b3d3a6c6d11c42a9828f085652af5c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdafaf0-b542-4db9-b0c7-be3c277b04cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bdafaf0-b542-4db9-b0c7-be3c277b04cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f293c431-f4c6-45e0-9912-8019899f363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f293c431-f4c6-45e0-9912-8019899f363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da4c3082-7a81-4b3f-a438-a6678d836d56', 'volume_name': 'volume-da4c3082-7a81-4b3f-a438-a6678d836d56', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd4fd2f-8392-4e79-a4d5-0f1d192397a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd4fd2f-8392-4e79-a4d5-0f1d192397a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc148a6-3992-4e88-b60b-0ba75f720fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:47 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Volume da4c3082-7a81-4b3f-a438-a6678d836d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da4c3082-7a81-4b3f-a438-a6678d836d56', 'volume_size': 1} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1803435320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da4c3082-7a81-4b3f-a438-a6678d836d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04c1d24d7714c468ca63211174b2a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:47Z,use_quota=True,user_id='b3d3a6c6d11c42a9828f085652af5c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Creating volume da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:47 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:47 devstack sudo[108517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 1073741824 Jun 23 04:34:47 devstack sudo[108517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:47 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.57c66789-783f-4c24-aa93-029780cdf9e7" returned: 0 in 0.799s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-57c66789-783f-4c24-aa93-029780cdf9e7" released by "_delete_snapshot" :: held 3.700s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" released by "delete_snapshot" :: held 3.733s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:47 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Created reservations ['e0491fed-1c95-4fdc-838e-bdd501224a11', '9d164c69-c17d-446f-b7be-1a73dbfe1e0c', '42a4c96d-581e-481f-b0a5-1a1adad1a057', '4331ca7b-608e-4252-ad20-46bbf5d411b3'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:48 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Delete snapshot completed successfully. Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-57c66789-783f-4c24-aa93-029780cdf9e7-delete_snapshot" released by "delete_snapshot" :: held 3.925s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-b32525bc-eb89-46a6-b695-46c1b0b335dc-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-b32525bc-eb89-46a6-b695-46c1b0b335dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-b32525bc-eb89-46a6-b695-46c1b0b335dc" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-b32525bc-eb89-46a6-b695-46c1b0b335dc" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Deleting offline snapshot b32525bc-eb89-46a6-b695-46c1b0b335dc of volume c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] snapshot_file for this snap is: volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[891d4e22-60e8-401b-b181-aa8de32a67f8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Flow 'volume_create_manager' (f5089cf6-43cc-424c-8408-aebf715dc32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d911a93e-6555-4c2a-a919-32972e6b9117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d911a93e-6555-4c2a-a919-32972e6b9117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1599272851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc2bcfb-b772-4722-9268-16d0f20c7195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9948beaf0f434797bd4674ca86478dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:48Z,use_quota=True,user_id='397dd32bb04a4ccabf9baf734a6f09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70cd8177-451b-43a8-ad6f-3ae8c66cfa79),volume_type_id=70cd8177-451b-43a8-ad6f-3ae8c66cfa79)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7de60a6-3396-48ca-8df0-8a41379b3436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7de60a6-3396-48ca-8df0-8a41379b3436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129b7924-2f11-4ac7-a6f2-28ae9b21f6dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack sudo[108520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:48 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (129b7924-2f11-4ac7-a6f2-28ae9b21f6dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbc2bcfb-b772-4722-9268-16d0f20c7195', 'volume_name': 'volume-dbc2bcfb-b772-4722-9268-16d0f20c7195', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63f6ac0-1931-46a3-a2ea-ed725d35de7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63f6ac0-1931-46a3-a2ea-ed725d35de7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4029829-769b-480e-93c9-1659faead3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume dbc2bcfb-b772-4722-9268-16d0f20c7195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbc2bcfb-b772-4722-9268-16d0f20c7195', 'volume_size': 1} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:48 devstack sudo[108517]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Flow 'volume_create_manager' (d11268f0-3eaf-49a7-9aea-818761bc4cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b096566-e4c8-4d54-a9b8-f8f658f1e07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 1073741824" returned: 0 in 1.169s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b096566-e4c8-4d54-a9b8-f8f658f1e07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2054460746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed47c78f-23f0-423d-af35-48dce20716c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9948beaf0f434797bd4674ca86478dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:49Z,use_quota=True,user_id='397dd32bb04a4ccabf9baf734a6f09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59ad8940-9012-41b8-8949-85d31fe92385),volume_type_id=59ad8940-9012-41b8-8949-85d31fe92385)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55680e0-dfa6-4f65-aa3e-7d319af5aaf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c55680e0-dfa6-4f65-aa3e-7d319af5aaf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33289c0-86f9-400f-aa08-acdc915e4c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33289c0-86f9-400f-aa08-acdc915e4c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed47c78f-23f0-423d-af35-48dce20716c1', 'volume_name': 'volume-ed47c78f-23f0-423d-af35-48dce20716c1', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155397b6-2acb-4eab-9953-9ee98041facb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (155397b6-2acb-4eab-9953-9ee98041facb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a04e7b4-f882-4dc6-978d-edce12da3803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume ed47c78f-23f0-423d-af35-48dce20716c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed47c78f-23f0-423d-af35-48dce20716c1', 'volume_size': 1} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:48 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:34:48 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:49 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 0.923s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f26b2ff-80ee-46cc-843a-b30096b1d2e3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:49 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 Jun 23 04:34:49 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Flow 'volume_create_manager' (9f768dea-1278-4286-91bb-2a63ea294e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfea317-cc20-46e7-bfb3-4a6ef438e4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bfea317-cc20-46e7-bfb3-4a6ef438e4d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1507360357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6563f088-844f-453f-ba1d-8d0588e76fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9948beaf0f434797bd4674ca86478dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:49Z,use_quota=True,user_id='397dd32bb04a4ccabf9baf734a6f09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d83b5ead-e58c-4f1b-986e-b8d9d5eaf2ea),volume_type_id=d83b5ead-e58c-4f1b-986e-b8d9d5eaf2ea)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60612ba-37c7-408c-b6ca-f944caf048c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f60612ba-37c7-408c-b6ca-f944caf048c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a9489f-ac2e-458f-9fd8-17648ecb34ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:34:49 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.695s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] <== create_volume: return (1962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.219s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1599272851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbc2bcfb-b772-4722-9268-16d0f20c7195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9948beaf0f434797bd4674ca86478dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:48Z,use_quota=True,user_id='397dd32bb04a4ccabf9baf734a6f09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70cd8177-451b-43a8-ad6f-3ae8c66cfa79),volume_type_id=70cd8177-451b-43a8-ad6f-3ae8c66cfa79)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Creating volume dbc2bcfb-b772-4722-9268-16d0f20c7195 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:49 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc148a6-3992-4e88-b60b-0ba75f720fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da4c3082-7a81-4b3f-a438-a6678d836d56', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f297673-9359-4a64-9a8c-24da5e9dc287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:49 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 1073741824 Jun 23 04:34:49 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Volume volume-da4c3082-7a81-4b3f-a438-a6678d836d56 (da4c3082-7a81-4b3f-a438-a6678d836d56): created successfully Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f297673-9359-4a64-9a8c-24da5e9dc287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Flow 'volume_create_manager' (d00211b6-65f7-4403-a740-3b637d40f5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:49 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-688b0320-9f3b-4783-a83e-d8dba5d25c82 tempest-VolumeDependencyTests-2094678752 None] Created volume successfully. Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4a9489f-ac2e-458f-9fd8-17648ecb34ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6563f088-844f-453f-ba1d-8d0588e76fea', 'volume_name': 'volume-6563f088-844f-453f-ba1d-8d0588e76fea', 'volume_size': 1, 'image_id': '9df12883-ca83-434d-be31-eef8cad3678d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9df12883-ca83-434d-be31-eef8cad3678d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1696613005', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9948beaf0f434797bd4674ca86478dba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9df12883-ca83-434d-be31-eef8cad3678d', 'created_at': datetime.datetime(2026, 6, 23, 2, 34, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9df12883-ca83-434d-be31-eef8cad3678d/file', 'properties': {}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8964f4dd-3037-422d-b469-bc0bae4ee30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8964f4dd-3037-422d-b469-bc0bae4ee30b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284617ae-97a6-4e7a-bb80-4fe9eb62ea43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume 6563f088-844f-453f-ba1d-8d0588e76fea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6563f088-844f-453f-ba1d-8d0588e76fea', 'volume_size': 1, 'image_id': '9df12883-ca83-434d-be31-eef8cad3678d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9df12883-ca83-434d-be31-eef8cad3678d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1696613005', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9948beaf0f434797bd4674ca86478dba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9df12883-ca83-434d-be31-eef8cad3678d', 'created_at': datetime.datetime(2026, 6, 23, 2, 34, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9df12883-ca83-434d-be31-eef8cad3678d/file', 'properties': {}}, 'image_service': } Jun 23 04:34:49 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Trying to clone 6563f088-844f-453f-ba1d-8d0588e76fea from image 9df12883-ca83-434d-be31-eef8cad3678d at location (None, [{'url': 'file:///opt/stack/data/glance/images/9df12883-ca83-434d-be31-eef8cad3678d', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:34:50 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000" returned: 0 in 0.896s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:50 devstack sudo[108540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:50 devstack sudo[108540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:50 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 1073741824" returned: 0 in 0.985s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:50 devstack sudo[108547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 Jun 23 04:34:50 devstack sudo[108547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:50 devstack sudo[108540]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:51 devstack sudo[108552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc Jun 23 04:34:51 devstack sudo[108552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:51 devstack sudo[108547]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195" returned: 0 in 0.707s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.764s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.505s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2054460746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed47c78f-23f0-423d-af35-48dce20716c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9948beaf0f434797bd4674ca86478dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:49Z,use_quota=True,user_id='397dd32bb04a4ccabf9baf734a6f09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59ad8940-9012-41b8-8949-85d31fe92385),volume_type_id=59ad8940-9012-41b8-8949-85d31fe92385)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Creating volume ed47c78f-23f0-423d-af35-48dce20716c1 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:51 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4029829-769b-480e-93c9-1659faead3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbc2bcfb-b772-4722-9268-16d0f20c7195', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:51 devstack sudo[108555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 1073741824 Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0135e3-8359-4767-bceb-1de25edb71b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:51 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 (dbc2bcfb-b772-4722-9268-16d0f20c7195): created successfully Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0135e3-8359-4767-bceb-1de25edb71b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Flow 'volume_create_manager' (f5089cf6-43cc-424c-8408-aebf715dc32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8a2d0ad4-87a0-4708-aeeb-d5faaced257b tempest-TestInstancesWithCinderVolumes-1902325835 None] Created volume successfully. Jun 23 04:34:51 devstack sudo[108552]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000.b32525bc-eb89-46a6-b695-46c1b0b335dc" returned: 0 in 0.677s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-b32525bc-eb89-46a6-b695-46c1b0b335dc" released by "_delete_snapshot" :: held 3.528s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" released by "delete_snapshot" :: held 3.564s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Created reservations ['503dcde2-1592-4568-a2ec-284fbb471b44', '19d34236-29be-4c48-b41e-982a8ba09ec0', '28bb195d-930f-4b07-b445-18a273653aa6', '009e06c0-1a9f-43c2-b581-31b631e8bca7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Delete snapshot completed successfully. Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-b32525bc-eb89-46a6-b695-46c1b0b335dc-delete_snapshot" released by "delete_snapshot" :: held 3.765s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Snapshots deleted, issuing volume delete {{(pid=93326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" acquired by "delete_volume" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3582eeb6-640e-44ea-9e8d-bee32489fa80]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:52 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 Jun 23 04:34:52 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:52 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 1073741824" returned: 0 in 0.967s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:52 devstack sudo[108563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 Jun 23 04:34:52 devstack sudo[108563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:52 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000" returned: 0 in 0.822s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:52 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000 Jun 23 04:34:52 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:53 devstack sudo[108563]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1" returned: 0 in 0.724s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.162s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a04e7b4-f882-4dc6-978d-edce12da3803) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed47c78f-23f0-423d-af35-48dce20716c1', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b49a92c-faf0-440d-b908-9685b24ee7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Creating offline snapshot 0e891893-4b6e-44a1-b2bf-d364d2d01df9 of volume da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:34:53 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume volume-ed47c78f-23f0-423d-af35-48dce20716c1 (ed47c78f-23f0-423d-af35-48dce20716c1): created successfully Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b49a92c-faf0-440d-b908-9685b24ee7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Flow 'volume_create_manager' (d11268f0-3eaf-49a7-9aea-818761bc4cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e797844b-2c51-415e-90a0-b66c79e8f0cb]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:53 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d460ce1b-7da9-494f-a635-0e81531363fc tempest-TestInstancesWithCinderVolumes-1902325835 None] Created volume successfully. Jun 23 04:34:53 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:34:53 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:53 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c9239f23-1ce7-4016-84c6-0a8fb16b1000" returned: 0 in 0.673s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-c9239f23-1ce7-4016-84c6-0a8fb16b1000" released by "delete_volume" :: held 1.574s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Created reservations ['dd50eb52-3e62-4a2d-a363-b33108fb5a21', '9f284757-f384-48fa-8d79-2c9ce25099bb', '0eb6560f-ad23-4b9c-aaf1-fbc8b18f8425', '8cee0859-b61a-4cfb-b308-6ac9829cd4c2'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:53 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:53 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD, size 20.69 MB, duration 3.96 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:34:53 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Image download 20.69 MB at 5.23 MB/s Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a6f776-65e6-4b57-bc3f-970826ef0240]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:54 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD Jun 23 04:34:54 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:54 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.882s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:54 devstack sudo[108581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 1G Jun 23 04:34:54 devstack sudo[108581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:54 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.715s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Deleted volume successfully. Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47d65f83-0dc1-4a88-9db8-3111945554a9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-c9239f23-1ce7-4016-84c6-0a8fb16b1000-delete_volume" released by "delete_volume" :: held 10.289s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:54 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:34:54 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Flow 'volume_create_manager' (9ed1130a-8704-4b52-afc6-c3d578c87a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db248ca1-7169-44d7-83f0-c47cc13eb117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db248ca1-7169-44d7-83f0-c47cc13eb117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431105170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e49faf7-2666-4f70-939d-d7ccd856f198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c79d334f4e045c2adaab4e995fd4f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:55Z,use_quota=True,user_id='ef40a9fbe5514a208a819189c7ee5dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1688796e-be4b-4ba5-863a-95e655fc80ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1688796e-be4b-4ba5-863a-95e655fc80ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac5e415-bef6-48b5-a9ad-a5633145be3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac5e415-bef6-48b5-a9ad-a5633145be3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e49faf7-2666-4f70-939d-d7ccd856f198', 'volume_name': 'volume-5e49faf7-2666-4f70-939d-d7ccd856f198', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a87f8e4-bdbb-494e-b145-06f5d8b95c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a87f8e4-bdbb-494e-b145-06f5d8b95c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c830ec-86da-4095-98c3-dae5851a8f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:54 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Volume 5e49faf7-2666-4f70-939d-d7ccd856f198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e49faf7-2666-4f70-939d-d7ccd856f198', 'volume_size': 1} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:54 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD" returned: 0 in 0.867s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Temporary image 9df12883-ca83-434d-be31-eef8cad3678d is fetched for user 397dd32bb04a4ccabf9baf734a6f09f4. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[09df2fbd-fe95-437d-8448-98d1e4bd4b91]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:54 devstack sudo[108581]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 1G" returned: 0 in 0.879s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4c3082-7a81-4b3f-a438-a6678d836d56 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:54 devstack sudo[108593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD Jun 23 04:34:54 devstack sudo[108593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:54 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4c3082-7a81-4b3f-a438-a6678d836d56 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 Jun 23 04:34:54 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:55 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.693s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:34:55 devstack sudo[108593]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:55 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da4c3082-7a81-4b3f-a438-a6678d836d56 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9" returned: 0 in 0.716s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:55 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 is being set with open permissions: ugo+rw Jun 23 04:34:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:55 devstack sudo[108604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 Jun 23 04:34:55 devstack sudo[108604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:56 devstack sudo[108604]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:56 devstack sudo[108607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info Jun 23 04:34:56 devstack sudo[108607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:57 devstack sudo[108607]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:57 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info is being set with open permissions: ugo+rw Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:57 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info Jun 23 04:34:57 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:57 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.info" returned: 0 in 0.660s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.591s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.958s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-431105170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e49faf7-2666-4f70-939d-d7ccd856f198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c79d334f4e045c2adaab4e995fd4f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:55Z,use_quota=True,user_id='ef40a9fbe5514a208a819189c7ee5dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Creating volume 5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:57 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:57 devstack sudo[108613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 1073741824 Jun 23 04:34:57 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:57 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-247d3237-6c19-4073-993c-2d7338d51bc3 tempest-VolumeDependencyTests-2094678752 None] Create snapshot completed successfully Jun 23 04:34:58 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 1073741824" returned: 0 in 0.862s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:58 devstack sudo[108620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:34:58 devstack sudo[108620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Flow 'volume_create_manager' (6aafae65-a5d0-4e4f-a65f-304064e02908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8649692-c323-45f7-8048-69187fb2270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8649692-c323-45f7-8048-69187fb2270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1584126528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b882d83-cfff-40bc-8774-119bef91963a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b04c1d24d7714c468ca63211174b2a9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e891893-4b6e-44a1-b2bf-d364d2d01df9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:59Z,use_quota=True,user_id='b3d3a6c6d11c42a9828f085652af5c51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e49189-ceab-4a10-8331-ca34f3a3936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63e49189-ceab-4a10-8331-ca34f3a3936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd61e5bf-3f81-4073-9378-21dd9e0575b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd61e5bf-3f81-4073-9378-21dd9e0575b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b882d83-cfff-40bc-8774-119bef91963a', 'volume_name': 'volume-6b882d83-cfff-40bc-8774-119bef91963a', 'volume_size': 1, 'snapshot_id': '0e891893-4b6e-44a1-b2bf-d364d2d01df9'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c9a9b3-d70c-4bca-a5ec-e50c47672b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c9a9b3-d70c-4bca-a5ec-e50c47672b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa79664-76bb-4f6c-8977-61d604c4d101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Volume 6b882d83-cfff-40bc-8774-119bef91963a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b882d83-cfff-40bc-8774-119bef91963a', 'volume_size': 1, 'snapshot_id': '0e891893-4b6e-44a1-b2bf-d364d2d01df9'} Jun 23 04:34:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:59 devstack sudo[108620]: pam_unix(sudo:session): session closed for user root Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.687s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.674s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:34:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1507360357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6563f088-844f-453f-ba1d-8d0588e76fea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9948beaf0f434797bd4674ca86478dba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:34:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:34:49Z,use_quota=True,user_id='397dd32bb04a4ccabf9baf734a6f09f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d83b5ead-e58c-4f1b-986e-b8d9d5eaf2ea),volume_type_id=d83b5ead-e58c-4f1b-986e-b8d9d5eaf2ea)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Creating volume 6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:34:59 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27c830ec-86da-4095-98c3-dae5851a8f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e49faf7-2666-4f70-939d-d7ccd856f198', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:59 devstack sudo[108623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea 1073741824 Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0bf4cb-2351-4969-b04f-8a0059b19082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:34:59 devstack sudo[108623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:34:59 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Volume volume-5e49faf7-2666-4f70-939d-d7ccd856f198 (5e49faf7-2666-4f70-939d-d7ccd856f198): created successfully Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b0bf4cb-2351-4969-b04f-8a0059b19082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:34:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Flow 'volume_create_manager' (9ed1130a-8704-4b52-afc6-c3d578c87a2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:34:59 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cb1dcc2a-484e-4e23-b778-d2b14550d654 tempest-VolumesDeleteCascade-1189080571 None] Created volume successfully. Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:00 devstack sudo[108623]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea 1073741824" returned: 0 in 0.881s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:00 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:35:00 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:00 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 0 in 0.671s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.996s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-quobyte-0e891893-4b6e-44a1-b2bf-d364d2d01df9-6b882d83-cfff-40bc-8774-119bef91963a" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-0e891893-4b6e-44a1-b2bf-d364d2d01df9-6b882d83-cfff-40bc-8774-119bef91963a" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Creating volume 6b882d83-cfff-40bc-8774-119bef91963a from snapshot 0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-quobyte-6b882d83-cfff-40bc-8774-119bef91963a" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Attempting download of 9df12883-ca83-434d-be31-eef8cad3678d ((None, [{'url': 'file:///opt/stack/data/glance/images/9df12883-ca83-434d-be31-eef8cad3678d', 'metadata': {}}])) to volume 6563f088-844f-453f-ba1d-8d0588e76fea. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-6b882d83-cfff-40bc-8774-119bef91963a" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] snapshot: 0e891893-4b6e-44a1-b2bf-d364d2d01df9, volume: 6b882d83-cfff-40bc-8774-119bef91963a, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db4d3a-c1dd-4483-9641-fbce1f918b97]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f359e2-3d83-4735-9d63-d1124ca843be]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:01 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48 Jun 23 04:35:01 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:01 devstack sudo[108669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 Jun 23 04:35:01 devstack sudo[108669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:01 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48" returned: 0 in 0.721s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:01 devstack sudo[108669]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9" returned: 0 in 0.799s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4c3082-7a81-4b3f-a438-a6678d836d56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:35:01 devstack sudo[108677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48 Jun 23 04:35:01 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9158a9ed-a75b-428e-82ed-f1d99b12d7c1]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:01 devstack sudo[108679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:35:01 devstack sudo[108679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:02 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48" returned: 1 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9df12883-ca83-434d-be31-eef8cad3678d_6l0mrm48' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f98f8-a7ba-4f62-a459-f80f3632ba21]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:02 devstack sudo[108689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD Jun 23 04:35:02 devstack sudo[108689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:02 devstack sudo[108679]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:35:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:02 devstack sudo[108691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a Jun 23 04:35:02 devstack sudo[108691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:03 devstack sudo[108689]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD" returned: 0 in 0.755s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:03 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] 9df12883-ca83-434d-be31-eef8cad3678d was qcow2, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:35:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:03 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:35:03 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:07 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 0 in 4.054s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:07 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9df12883-ca83-434d-be31-eef8cad3678d_2t3wwqngdevstack@QuobyteHD, size 112.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:35:07 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Converted 112.00 MB image at 27.60 MB/s Jun 23 04:35:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:07 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea 1G Jun 23 04:35:07 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:07 devstack sudo[108691]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a" returned: 0 in 4.985s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:07 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4026c1a-982e-44eb-aafe-e8f040e6e243]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:07 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:35:07 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:08 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea 1G" returned: 0 in 0.771s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb1261f-d14c-4c66-a930-4890a04ef339]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:08 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:35:08 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:08 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.942s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56, size 1024.00 MB, duration 4.99 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:35:08 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Converted 1024.00 MB image at 205.35 MB/s Jun 23 04:35:08 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a is being set with open permissions: ugo+rw Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:08 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a Jun 23 04:35:08 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:08 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 0 in 0.737s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:08 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:35:08 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:09 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a" returned: 0 in 0.709s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-6b882d83-cfff-40bc-8774-119bef91963a" released by "_copy_volume_from_snapshot" :: held 8.297s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-0e891893-4b6e-44a1-b2bf-d364d2d01df9-6b882d83-cfff-40bc-8774-119bef91963a" released by "_create_volume_from_snapshot" :: held 8.346s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.373s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.235s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Creating offline snapshot 5ea96447-e8f4-4580-b38d-b15dc0811e0c of volume 5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f345d6-0ce7-4c54-b00a-dbff2df69aee]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa79664-76bb-4f6c-8977-61d604c4d101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b882d83-cfff-40bc-8774-119bef91963a', 'volume_size': 1, 'snapshot_id': '0e891893-4b6e-44a1-b2bf-d364d2d01df9'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfff228-131c-41fd-b80b-90c9a1df96e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:09 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Volume volume-6b882d83-cfff-40bc-8774-119bef91963a (6b882d83-cfff-40bc-8774-119bef91963a): created successfully Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bfff228-131c-41fd-b80b-90c9a1df96e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Flow 'volume_create_manager' (6aafae65-a5d0-4e4f-a65f-304064e02908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-14e3d3af-5e4a-403c-a8fe-109bb551a695 tempest-VolumeDependencyTests-2094678752 None] Created volume successfully. Jun 23 04:35:09 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:35:09 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:09 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-0e891893-4b6e-44a1-b2bf-d364d2d01df9-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 1 in 0.811s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Downloaded image 9df12883-ca83-434d-be31-eef8cad3678d ((None, [{'url': 'file:///opt/stack/data/glance/images/9df12883-ca83-434d-be31-eef8cad3678d', 'metadata': {}}])) to volume 6563f088-844f-453f-ba1d-8d0588e76fea successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Temporary image 9df12883-ca83-434d-be31-eef8cad3678d for user 397dd32bb04a4ccabf9baf734a6f09f4 is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Marking volume 6563f088-844f-453f-ba1d-8d0588e76fea as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-0e891893-4b6e-44a1-b2bf-d364d2d01df9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-quobyte-da4c3082-7a81-4b3f-a438-a6678d836d56" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Copying metadata from image 9df12883-ca83-434d-be31-eef8cad3678d to 6563f088-844f-453f-ba1d-8d0588e76fea. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Creating volume glance metadata for volume 6563f088-844f-453f-ba1d-8d0588e76fea backed by image 9df12883-ca83-434d-be31-eef8cad3678d with: {'image_id': '9df12883-ca83-434d-be31-eef8cad3678d', 'image_name': 'tempest-scenario-img--1696613005', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-da4c3082-7a81-4b3f-a438-a6678d836d56" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-quobyte-0e891893-4b6e-44a1-b2bf-d364d2d01df9" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-0e891893-4b6e-44a1-b2bf-d364d2d01df9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Deleting offline snapshot 0e891893-4b6e-44a1-b2bf-d364d2d01df9 of volume da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] snapshot_file for this snap is: volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7c3f6a-763c-47bc-877e-597a12e77a7d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (284617ae-97a6-4e7a-bb80-4fe9eb62ea43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6563f088-844f-453f-ba1d-8d0588e76fea', 'volume_size': 1, 'image_id': '9df12883-ca83-434d-be31-eef8cad3678d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9df12883-ca83-434d-be31-eef8cad3678d', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1696613005', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '9948beaf0f434797bd4674ca86478dba', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9df12883-ca83-434d-be31-eef8cad3678d', 'created_at': datetime.datetime(2026, 6, 23, 2, 34, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 34, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9df12883-ca83-434d-be31-eef8cad3678d/file', 'properties': {}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd6214b-64f3-4ab1-b97a-3f0d59bf61c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:09 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Volume volume-6563f088-844f-453f-ba1d-8d0588e76fea (6563f088-844f-453f-ba1d-8d0588e76fea): created successfully Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dd6214b-64f3-4ab1-b97a-3f0d59bf61c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Flow 'volume_create_manager' (9f768dea-1278-4286-91bb-2a63ea294e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-986876d4-7c04-4064-9cd4-0bd0c8026510 tempest-TestInstancesWithCinderVolumes-1902325835 None] Created volume successfully. Jun 23 04:35:09 devstack sudo[108739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 Jun 23 04:35:09 devstack sudo[108739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:10 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.784s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:10 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c 1G Jun 23 04:35:10 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:10 devstack sudo[108739]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9" returned: 0 in 0.767s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da4c3082-7a81-4b3f-a438-a6678d836d56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e6c7be-1fe7-433a-a1f5-bd5950a1b757]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:10 devstack sudo[108749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:35:10 devstack sudo[108749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:10 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c 1G" returned: 0 in 0.829s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e49faf7-2666-4f70-939d-d7ccd856f198 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:10 devstack sudo[108754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e49faf7-2666-4f70-939d-d7ccd856f198 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c Jun 23 04:35:10 devstack sudo[108754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:11 devstack sudo[108749]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.806s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:11 devstack sudo[108759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 Jun 23 04:35:11 devstack sudo[108759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:11 devstack sudo[108754]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e49faf7-2666-4f70-939d-d7ccd856f198 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c" returned: 0 in 0.733s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:11 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c is being set with open permissions: ugo+rw Jun 23 04:35:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:11 devstack sudo[108765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c Jun 23 04:35:11 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:12 devstack sudo[108759]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9" returned: 0 in 0.830s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:12 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9 Jun 23 04:35:12 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:12 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c" returned: 0 in 0.765s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:12 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info Jun 23 04:35:12 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:12 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56.0e891893-4b6e-44a1-b2bf-d364d2d01df9" returned: 0 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-0e891893-4b6e-44a1-b2bf-d364d2d01df9" released by "_delete_snapshot" :: held 3.260s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-da4c3082-7a81-4b3f-a438-a6678d836d56" released by "delete_snapshot" :: held 3.286s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Created reservations ['7c7a3714-f497-43dd-97c5-8172930c26b5', 'cc5c109a-eea3-4a08-9347-c9c465aaceb5', '75bdb01e-881b-45b4-b555-8e2e44024612', '50f5ee85-f6be-44e2-92d8-cb8262a1cd3b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Delete snapshot completed successfully. Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-20841875-b60a-49ec-8f48-4a299d0ab286 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-0e891893-4b6e-44a1-b2bf-d364d2d01df9-delete_snapshot" released by "delete_snapshot" :: held 3.430s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:13 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info" returned: 0 in 0.712s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:13 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info is being set with open permissions: ugo+rw Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:13 devstack sudo[108781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info Jun 23 04:35:13 devstack sudo[108781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:13 devstack sudo[108781]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.info" returned: 0 in 0.680s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.604s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-62ed935e-ab0d-4c1d-b19a-06ff388d860b tempest-VolumesDeleteCascade-1189080571 None] Create snapshot completed successfully Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-da4c3082-7a81-4b3f-a438-a6678d836d56-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-da4c3082-7a81-4b3f-a438-a6678d836d56-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-quobyte-da4c3082-7a81-4b3f-a438-a6678d836d56" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-da4c3082-7a81-4b3f-a438-a6678d836d56" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:14 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7f5e37-d26d-484c-8f9f-d95fd861da42]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:14 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:35:14 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:14 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.768s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:14 devstack sudo[108789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56 Jun 23 04:35:14 devstack sudo[108789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Flow 'volume_create_manager' (47dfde9c-412f-4126-85f0-3719a2be9a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d984a56-ae4a-47e1-9cd8-1b5bc81ed633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d984a56-ae4a-47e1-9cd8-1b5bc81ed633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-55262510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c48a27-3ec7-4fe3-afd4-4271c555bf42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c79d334f4e045c2adaab4e995fd4f21',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5ea96447-e8f4-4580-b38d-b15dc0811e0c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:15Z,use_quota=True,user_id='ef40a9fbe5514a208a819189c7ee5dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868b82f5-1ef5-45cc-b0d9-d6705b86b821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (868b82f5-1ef5-45cc-b0d9-d6705b86b821) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc6e3ae-d850-4787-8927-c4c7ee45683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc6e3ae-d850-4787-8927-c4c7ee45683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '18c48a27-3ec7-4fe3-afd4-4271c555bf42', 'volume_name': 'volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42', 'volume_size': 1, 'snapshot_id': '5ea96447-e8f4-4580-b38d-b15dc0811e0c'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6e812e-1485-4480-af2b-3545bcc60ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6e812e-1485-4480-af2b-3545bcc60ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c959652-9058-4234-95e5-c9b910d1f1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Volume 18c48a27-3ec7-4fe3-afd4-4271c555bf42: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42', 'volume_size': 1, 'snapshot_id': '5ea96447-e8f4-4580-b38d-b15dc0811e0c'} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-5ea96447-e8f4-4580-b38d-b15dc0811e0c-18c48a27-3ec7-4fe3-afd4-4271c555bf42" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5ea96447-e8f4-4580-b38d-b15dc0811e0c-18c48a27-3ec7-4fe3-afd4-4271c555bf42" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Creating volume 18c48a27-3ec7-4fe3-afd4-4271c555bf42 from snapshot 5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:35:15 devstack sudo[108789]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-18c48a27-3ec7-4fe3-afd4-4271c555bf42" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-da4c3082-7a81-4b3f-a438-a6678d836d56" returned: 0 in 0.727s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-18c48a27-3ec7-4fe3-afd4-4271c555bf42" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] snapshot: 5ea96447-e8f4-4580-b38d-b15dc0811e0c, volume: 18c48a27-3ec7-4fe3-afd4-4271c555bf42, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-da4c3082-7a81-4b3f-a438-a6678d836d56" released by "delete_volume" :: held 1.556s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c96f5d2-8e2d-4f87-9ad9-51d28d595e50]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Created reservations ['63267d76-a9c1-4701-89cd-2bc33e091d10', 'e857c05f-6806-40ff-ba20-24e19800e18b', '9c21cbae-723b-4bec-bc84-0c5077fe6cb4', '96e44af8-56a7-479d-bb19-03792710f161'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:15 devstack sudo[108792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c Jun 23 04:35:15 devstack sudo[108792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:15 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:15 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-6b882d83-cfff-40bc-8774-119bef91963a-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-6b882d83-cfff-40bc-8774-119bef91963a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "cinder-quobyte-6b882d83-cfff-40bc-8774-119bef91963a" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-6b882d83-cfff-40bc-8774-119bef91963a" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79778ea-8885-4a46-b0da-ba453eeecbd7]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:16 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.718s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:16 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a Jun 23 04:35:16 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:16 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Deleted volume successfully. Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c33bd0af-240c-4696-a52b-83e097f40cf4 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-da4c3082-7a81-4b3f-a438-a6678d836d56-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:16 devstack sudo[108792]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c" returned: 0 in 0.914s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e49faf7-2666-4f70-939d-d7ccd856f198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[547295d7-2eac-4cef-b674-510c53e7dd11]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:16 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:35:16 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:17 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a" returned: 0 in 0.873s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:17 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a Jun 23 04:35:17 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:17 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.981s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:17 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:35:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:17 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 Jun 23 04:35:17 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:18 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6b882d83-cfff-40bc-8774-119bef91963a" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-quobyte-6b882d83-cfff-40bc-8774-119bef91963a" released by "delete_volume" :: held 1.781s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Created reservations ['8f9a6b39-91d7-4900-bbfb-5f3751076552', 'bacf656f-e26d-4bca-8387-8e71bff81e97', '7807a9d3-127b-4c6d-8ccd-63c3f1a4acf2', '1ebff30b-8911-47dd-8fbe-b4c09368fd94'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:18 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:18 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:19 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.688s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:20 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Deleted volume successfully. Jun 23 04:35:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5386d9ec-e58c-460f-8357-ce4d0e72fe93 tempest-VolumeDependencyTests-2094678752 None] Lock "cinder-6b882d83-cfff-40bc-8774-119bef91963a-delete_volume" released by "delete_volume" :: held 3.851s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:23 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42" returned: 0 in 6.366s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:23 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc094570-165b-4a35-9d1c-551b7e0c56b0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:24 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:35:24 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Flow 'volume_create_manager' (18f70389-ea42-4c6d-ac8f-4480bf0612ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2ceb04-2109-4deb-9740-7a80d0305436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa2ceb04-2109-4deb-9740-7a80d0305436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00b3463-6145-429e-8c17-fa9d5826a4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70278a67edf4fb1bd5906b1c2c01711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:25Z,use_quota=True,user_id='518391800ab34564924f8fbb8e5b0728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9c3cbc-a651-4e2c-a1b9-f5f0ed8f460b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9c3cbc-a651-4e2c-a1b9-f5f0ed8f460b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbb6cbe-c07f-4f45-903c-68015509ceb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddbb6cbe-c07f-4f45-903c-68015509ceb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a00b3463-6145-429e-8c17-fa9d5826a4ff', 'volume_name': 'volume-a00b3463-6145-429e-8c17-fa9d5826a4ff', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9c9613-4809-4dcb-9ae8-2c8fdf183f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa9c9613-4809-4dcb-9ae8-2c8fdf183f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e444d7-fcc5-4a7f-b5fc-a2e68e01c549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:24 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Volume a00b3463-6145-429e-8c17-fa9d5826a4ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a00b3463-6145-429e-8c17-fa9d5826a4ff', 'volume_size': 1} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:24 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.973s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198, size 1024.00 MB, duration 6.37 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:35:24 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Converted 1024.00 MB image at 160.82 MB/s Jun 23 04:35:24 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 is being set with open permissions: ugo+rw Jun 23 04:35:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:24 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 Jun 23 04:35:24 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:25 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42" returned: 0 in 0.631s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-18c48a27-3ec7-4fe3-afd4-4271c555bf42" released by "_copy_volume_from_snapshot" :: held 9.971s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5ea96447-e8f4-4580-b38d-b15dc0811e0c-18c48a27-3ec7-4fe3-afd4-4271c555bf42" released by "_create_volume_from_snapshot" :: held 10.008s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.028s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.119s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c959652-9058-4234-95e5-c9b910d1f1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42', 'volume_size': 1, 'snapshot_id': '5ea96447-e8f4-4580-b38d-b15dc0811e0c'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e619106-0b15-452d-84e8-1c021bc51260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6951549-858a-42bf-aaf6-57dd752b01b1]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:25 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Volume volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 (18c48a27-3ec7-4fe3-afd4-4271c555bf42): created successfully Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e619106-0b15-452d-84e8-1c021bc51260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Flow 'volume_create_manager' (47dfde9c-412f-4126-85f0-3719a2be9a81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:25 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f6ec2414-2582-4ea1-ac85-53092051c7d9 tempest-VolumesDeleteCascade-1189080571 None] Created volume successfully. Jun 23 04:35:25 devstack sudo[108851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:35:25 devstack sudo[108851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-5e49faf7-2666-4f70-939d-d7ccd856f198-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-5e49faf7-2666-4f70-939d-d7ccd856f198-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Performing cascade delete. {{(pid=93326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-5ea96447-e8f4-4580-b38d-b15dc0811e0c-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-5ea96447-e8f4-4580-b38d-b15dc0811e0c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-5e49faf7-2666-4f70-939d-d7ccd856f198" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5e49faf7-2666-4f70-939d-d7ccd856f198" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-5ea96447-e8f4-4580-b38d-b15dc0811e0c" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5ea96447-e8f4-4580-b38d-b15dc0811e0c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Deleting offline snapshot 5ea96447-e8f4-4580-b38d-b15dc0811e0c of volume 5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] snapshot_file for this snap is: volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ae9dc3-0f0a-4668-a07d-2fda47fcf0f1]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:26 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c Jun 23 04:35:26 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:26 devstack sudo[108851]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 0 in 0.758s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:26 devstack sudo[108857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:35:26 devstack sudo[108857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:26 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e49faf7-2666-4f70-939d-d7ccd856f198(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a38c481-5635-4f7a-bf7e-078a5f729ce3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:27 devstack sudo[108862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:35:27 devstack sudo[108862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:27 devstack sudo[108857]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 1 in 0.785s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.596s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.262s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a00b3463-6145-429e-8c17-fa9d5826a4ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70278a67edf4fb1bd5906b1c2c01711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:25Z,use_quota=True,user_id='518391800ab34564924f8fbb8e5b0728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Creating volume a00b3463-6145-429e-8c17-fa9d5826a4ff {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:35:27 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:INSERT=35,cinder:UPDATE=123,cinder:SELECT=112,cinder:DELETE=12 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=98,cinder:INSERT=35,cinder:UPDATE=124,cinder:DELETE=9 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:35:27 devstack sudo[108867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff 1073741824 Jun 23 04:35:27 devstack sudo[108867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-6563f088-844f-453f-ba1d-8d0588e76fea', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472cc56a-d9a6-4a2e-aebd-094dbe273e14', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:35:27 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-8593dcc8-643e-453f-b8e0-93fbc6a0f69a req-5d4194de-1cca-4054-acbe-65c4508a959f tempest-TestInstancesWithCinderVolumes-1902325835 None] attachment_update completed successfully. Jun 23 04:35:27 devstack sudo[108862]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.806s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:27 devstack sudo[108874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c Jun 23 04:35:27 devstack sudo[108874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:28 devstack sudo[108867]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff 1073741824" returned: 0 in 0.886s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:28 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff Jun 23 04:35:28 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:28 devstack sudo[108874]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c" returned: 0 in 0.743s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:28 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c Jun 23 04:35:28 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:28 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff" returned: 0 in 0.668s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e444d7-fcc5-4a7f-b5fc-a2e68e01c549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a00b3463-6145-429e-8c17-fa9d5826a4ff', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6bf79e-a89c-484a-a242-8e6262dfa7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:28 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Volume volume-a00b3463-6145-429e-8c17-fa9d5826a4ff (a00b3463-6145-429e-8c17-fa9d5826a4ff): created successfully Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6bf79e-a89c-484a-a242-8e6262dfa7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:28 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Flow 'volume_create_manager' (18f70389-ea42-4c6d-ac8f-4480bf0612ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-61376be6-3023-481b-a6c7-4a1b131f9881 tempest-CinderUnicodeTest-656143041 None] Created volume successfully. Jun 23 04:35:29 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198.5ea96447-e8f4-4580-b38d-b15dc0811e0c" returned: 0 in 0.666s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5ea96447-e8f4-4580-b38d-b15dc0811e0c" released by "_delete_snapshot" :: held 3.113s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5e49faf7-2666-4f70-939d-d7ccd856f198" released by "delete_snapshot" :: held 3.139s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Created reservations ['90b0025b-eda3-488f-a01b-c9edfeace48d', 'e34306ba-d478-419f-a23a-76ccc7a708d6', 'c4daba00-003b-4a7a-8fa8-329106ec9ccf', '7c97d746-8c99-4872-9990-3addd54584e5'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:29 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Delete snapshot completed successfully. Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-5ea96447-e8f4-4580-b38d-b15dc0811e0c-delete_snapshot" released by "delete_snapshot" :: held 3.334s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Snapshots deleted, issuing volume delete {{(pid=93326) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-5e49faf7-2666-4f70-939d-d7ccd856f198" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5e49faf7-2666-4f70-939d-d7ccd856f198" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a5a786-66f6-41dd-81f6-3c9286cce991]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:29 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:35:29 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Flow 'volume_create_manager' (7ae7707f-89e8-40b1-ae43-2e3ddf4f36e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553a4146-7356-4c16-8fba-2d3b6e636581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (553a4146-7356-4c16-8fba-2d3b6e636581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-556596295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ae70a5-82b7-4a79-b1ff-480405d9cf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70278a67edf4fb1bd5906b1c2c01711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:30Z,use_quota=True,user_id='518391800ab34564924f8fbb8e5b0728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd0e726-efe1-4d04-8c7f-624bde80bc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd0e726-efe1-4d04-8c7f-624bde80bc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48b18f8-a188-44e1-8aa8-2a0c29759e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48b18f8-a188-44e1-8aa8-2a0c29759e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1ae70a5-82b7-4a79-b1ff-480405d9cf3e', 'volume_name': 'volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb451f3-9f39-450a-bfa7-3c2a48ddf071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb451f3-9f39-450a-bfa7-3c2a48ddf071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de55ebd9-64a1-4657-8cf0-c98c1bcbbc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:29 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Volume e1ae70a5-82b7-4a79-b1ff-480405d9cf3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e', 'volume_size': 1} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-556596295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1ae70a5-82b7-4a79-b1ff-480405d9cf3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b70278a67edf4fb1bd5906b1c2c01711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:30Z,use_quota=True,user_id='518391800ab34564924f8fbb8e5b0728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Creating volume e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:35:29 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:35:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:29 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e 1073741824 Jun 23 04:35:29 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:30 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.784s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:30 devstack sudo[108963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198 Jun 23 04:35:30 devstack sudo[108963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:30 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e 1073741824" returned: 0 in 0.916s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:30 devstack sudo[108973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e Jun 23 04:35:30 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:30 devstack sudo[108963]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-5e49faf7-2666-4f70-939d-d7ccd856f198" returned: 0 in 0.679s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-5e49faf7-2666-4f70-939d-d7ccd856f198" released by "delete_volume" :: held 1.547s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:30 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Created reservations ['09473c81-e0af-4c01-9206-064ed56c7c85', '4be39938-a748-441d-a4cc-6cc78c2cc2f5', '18b5932d-ae0c-4ad0-a7ab-3f530607e533', 'd0e69401-38c9-4cff-a97c-61e9fa9446c7'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:31 devstack sudo[108976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:31 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:31 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" returned: 0 in 0.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de55ebd9-64a1-4657-8cf0-c98c1bcbbc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa6c567-b869-489f-ac3e-42bad7cd2235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:31 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Volume volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e (e1ae70a5-82b7-4a79-b1ff-480405d9cf3e): created successfully Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa6c567-b869-489f-ac3e-42bad7cd2235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Flow 'volume_create_manager' (7ae7707f-89e8-40b1-ae43-2e3ddf4f36e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2edb7e81-4565-4759-9e0f-c15fece8edb9 tempest-CinderUnicodeTest-656143041 None] Created volume successfully. Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-18c48a27-3ec7-4fe3-afd4-4271c555bf42-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-18c48a27-3ec7-4fe3-afd4-4271c555bf42-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "cinder-quobyte-18c48a27-3ec7-4fe3-afd4-4271c555bf42" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-18c48a27-3ec7-4fe3-afd4-4271c555bf42" acquired by "delete_volume" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2701a33c-58e5-4772-a07c-4a36cc939e3a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:31 devstack sudo[108979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 Jun 23 04:35:31 devstack sudo[108979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:31 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.728s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:31 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Deleted volume successfully. Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a1d2c547-0dce-4dc5-bc31-d90206be4820 tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-5e49faf7-2666-4f70-939d-d7ccd856f198-delete_volume" released by "delete_volume" :: held 5.866s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Creating offline snapshot a022c780-f4ac-4714-a1bf-d9adcdc71b34 of volume e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffcc9b1-bd55-4df1-9058-2a40e9e53f66]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:32 devstack sudo[108984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e Jun 23 04:35:32 devstack sudo[108984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:32 devstack sudo[108979]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42" returned: 0 in 0.842s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:32 devstack sudo[109311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42 Jun 23 04:35:32 devstack sudo[109311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:32 devstack sudo[108984]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" returned: 0 in 0.932s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:33 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 1G Jun 23 04:35:33 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:33 devstack sudo[109311]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-18c48a27-3ec7-4fe3-afd4-4271c555bf42" returned: 0 in 1.082s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-quobyte-18c48a27-3ec7-4fe3-afd4-4271c555bf42" released by "delete_volume" :: held 1.994s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Created reservations ['45fd8160-b857-4f2e-83de-d93d7d2420a9', '9d46f8be-a9e8-439a-b5f3-1ec616a3589b', '97055597-3ff1-4eaf-8313-3d5764001e4e', '3a783582-9ac3-4451-a979-e459b0ecc53f'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:33 devstack sudo[109385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:33 devstack sudo[109385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:34 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 1G" returned: 0 in 1.369s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:34 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 Jun 23 04:35:34 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:34 devstack sudo[109385]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:34 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:34 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Deleted volume successfully. Jun 23 04:35:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fff911f2-f8e4-409d-a9ac-6912824f21fa tempest-VolumesDeleteCascade-1189080571 None] Lock "cinder-18c48a27-3ec7-4fe3-afd4-4271c555bf42-delete_volume" released by "delete_volume" :: held 3.254s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:35 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34" returned: 0 in 0.818s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:35 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 is being set with open permissions: ugo+rw Jun 23 04:35:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:35 devstack sudo[109402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 Jun 23 04:35:35 devstack sudo[109402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:36 devstack sudo[109402]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34" returned: 0 in 0.877s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:36 devstack sudo[109405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info Jun 23 04:35:36 devstack sudo[109405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:36 devstack sudo[109405]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info" returned: 0 in 0.902s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:36 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info is being set with open permissions: ugo+rw Jun 23 04:35:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:37 devstack sudo[109409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info Jun 23 04:35:37 devstack sudo[109409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:37 devstack sudo[109409]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.info" returned: 0 in 0.986s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.024s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a45b2ca3-a9c9-433f-880b-51ecbad5f2d8 tempest-CinderUnicodeTest-656143041 None] Create snapshot completed successfully Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-a022c780-f4ac-4714-a1bf-d9adcdc71b34-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-a022c780-f4ac-4714-a1bf-d9adcdc71b34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-quobyte-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-quobyte-a022c780-f4ac-4714-a1bf-d9adcdc71b34" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-a022c780-f4ac-4714-a1bf-d9adcdc71b34" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Deleting offline snapshot a022c780-f4ac-4714-a1bf-d9adcdc71b34 of volume e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] snapshot_file for this snap is: volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe911f62-cc5b-4be6-adf2-068d0023fdfe]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:38 devstack sudo[109413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 Jun 23 04:35:38 devstack sudo[109413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Flow 'volume_create_manager' (a9d843de-1e2c-40c0-940d-6f7fda86ed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a80f72f-7d2e-4686-b031-ad61485a0417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a80f72f-7d2e-4686-b031-ad61485a0417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-865526491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58f0507-7b4a-4265-8ec5-ce34a03f1a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccab1958ee04a11823937a846422c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:39Z,use_quota=True,user_id='961444b33ef6451b8bd67b21e5a4f34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef64afa5-cb12-435d-b5bb-4589f725942e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef64afa5-cb12-435d-b5bb-4589f725942e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91b0470-45db-4192-996e-98de7ddd65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91b0470-45db-4192-996e-98de7ddd65cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58f0507-7b4a-4265-8ec5-ce34a03f1a26', 'volume_name': 'volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5722f39f-9dda-497b-b122-ba4ddcd1d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5722f39f-9dda-497b-b122-ba4ddcd1d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8d15af-9a82-42d9-9285-d55adc6db39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:39 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Volume c58f0507-7b4a-4265-8ec5-ce34a03f1a26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26', 'volume_size': 1} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-865526491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58f0507-7b4a-4265-8ec5-ce34a03f1a26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ccab1958ee04a11823937a846422c9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:39Z,use_quota=True,user_id='961444b33ef6451b8bd67b21e5a4f34a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Creating volume c58f0507-7b4a-4265-8ec5-ce34a03f1a26 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:35:39 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:39 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 1073741824 Jun 23 04:35:39 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:39 devstack sudo[109413]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34" returned: 0 in 1.356s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:35:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ac1b16f-7897-4ea4-89e4-a202843331fe]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:40 devstack sudo[109424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e Jun 23 04:35:40 devstack sudo[109424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:40 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 1073741824" returned: 0 in 1.176s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:40 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 Jun 23 04:35:40 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:41 devstack sudo[109424]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" returned: 0 in 1.038s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:41 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 Jun 23 04:35:41 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:41 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26" returned: 0 in 1.134s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] <== create_volume: return (2366ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.372s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8d15af-9a82-42d9-9285-d55adc6db39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085223b5-4dc9-4aba-8d95-c2e4e91e2e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:41 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Volume volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 (c58f0507-7b4a-4265-8ec5-ce34a03f1a26): created successfully Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (085223b5-4dc9-4aba-8d95-c2e4e91e2e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Flow 'volume_create_manager' (a9d843de-1e2c-40c0-940d-6f7fda86ed93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b438cf32-c0ad-489f-b121-5bbf504f19bb tempest-VolumesMetadataTest-1516615368 None] Created volume successfully. Jun 23 04:35:42 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34" returned: 0 in 0.955s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:42 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34 Jun 23 04:35:42 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:42 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e.a022c780-f4ac-4714-a1bf-d9adcdc71b34" returned: 0 in 0.942s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-a022c780-f4ac-4714-a1bf-d9adcdc71b34" released by "_delete_snapshot" :: held 4.475s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Acquiring lock "cinder-c58f0507-7b4a-4265-8ec5-ce34a03f1a26-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" released by "delete_snapshot" :: held 4.525s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Lock "cinder-c58f0507-7b4a-4265-8ec5-ce34a03f1a26-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Acquiring lock "cinder-quobyte-c58f0507-7b4a-4265-8ec5-ce34a03f1a26" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Lock "cinder-quobyte-c58f0507-7b4a-4265-8ec5-ce34a03f1a26" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Created reservations ['9527fe1b-0bec-4c74-bd56-c2ce363bd711', 'f7f7e4e1-dc8a-4583-8e93-c6f0e38333af', '7a8dfa24-8fee-44ae-84e3-596e2888f5ea', '57a735c7-ea42-4431-b3a4-019f66473409'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7fcdb1-01ae-4567-b79e-9cd7b9463684]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Delete snapshot completed successfully. Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2f910786-0fbc-45a8-8cb7-0f5a716bd992 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-a022c780-f4ac-4714-a1bf-d9adcdc71b34-delete_snapshot" released by "delete_snapshot" :: held 4.812s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:43 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 Jun 23 04:35:43 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-quobyte-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" acquired by "delete_volume" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:44 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b746e073-0bc7-4f16-88e3-4abd133233ea]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:44 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26" returned: 0 in 1.051s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:44 devstack sudo[109454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26 Jun 23 04:35:44 devstack sudo[109454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:44 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e Jun 23 04:35:44 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:45 devstack sudo[109454]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c58f0507-7b4a-4265-8ec5-ce34a03f1a26" returned: 0 in 0.909s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Lock "cinder-quobyte-c58f0507-7b4a-4265-8ec5-ce34a03f1a26" released by "delete_volume" :: held 2.006s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Created reservations ['cf68845f-f6e2-446a-adaf-8029d9c85696', '34cc981a-fa68-46b7-86aa-7b6cadf52ad4', '2fc7ef78-c7f0-4b35-8a8d-8d4f24ab13ed', '02073a76-7fac-4f4b-8131-6508a716991e'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:45 devstack sudo[109462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:45 devstack sudo[109462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:45 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" returned: 0 in 1.340s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:45 devstack sudo[109464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e Jun 23 04:35:45 devstack sudo[109464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:46 devstack sudo[109462]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.102s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:46 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Deleted volume successfully. Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8d961089-1284-44c3-9051-0b011a338f88 tempest-VolumesMetadataTest-1516615368 None] Lock "cinder-c58f0507-7b4a-4265-8ec5-ce34a03f1a26-delete_volume" released by "delete_volume" :: held 3.426s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:46 devstack sudo[109464]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" returned: 0 in 1.055s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e" released by "delete_volume" :: held 2.492s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Created reservations ['770c3df1-0a3a-4993-a435-a27e141d03bd', '33716cec-75c4-49c5-806d-93139981def9', 'f540dbe0-138c-456c-9329-720b79a0d61c', 'c22d0248-0031-4762-85ee-a7405f228553'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:46 devstack sudo[109468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:46 devstack sudo[109468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-a00b3463-6145-429e-8c17-fa9d5826a4ff-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-a00b3463-6145-429e-8c17-fa9d5826a4ff-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "cinder-quobyte-a00b3463-6145-429e-8c17-fa9d5826a4ff" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-a00b3463-6145-429e-8c17-fa9d5826a4ff" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[415e1e90-2867-452d-8513-11eddefbe23c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:47 devstack sudo[109468]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.848s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:47 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Deleted volume successfully. Jun 23 04:35:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-70fe7e03-112b-4f32-9425-ad97f371f580 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-e1ae70a5-82b7-4a79-b1ff-480405d9cf3e-delete_volume" released by "delete_volume" :: held 3.705s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:47 devstack sudo[109471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff Jun 23 04:35:47 devstack sudo[109471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:48 devstack sudo[109471]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff" returned: 0 in 0.883s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:48 devstack sudo[109476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff Jun 23 04:35:48 devstack sudo[109476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:49 devstack sudo[109476]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a00b3463-6145-429e-8c17-fa9d5826a4ff" returned: 0 in 0.699s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-quobyte-a00b3463-6145-429e-8c17-fa9d5826a4ff" released by "delete_volume" :: held 1.627s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Created reservations ['f8d4ebc8-0a6f-429a-a535-f8af5d44ed83', '8c4e3b9b-7843-4631-ba88-0a8015f9579c', '1b23e02e-9b76-4ac4-b903-6e5b66b2dcb2', 'e102aad5-acbb-4750-8384-3f0bc7be6247'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:49 devstack sudo[109506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:49 devstack sudo[109506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Flow 'volume_create_manager' (e4385203-a568-41b4-a755-b70c70eab548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1658c32-830f-4d73-9513-0795cfdf0a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1658c32-830f-4d73-9513-0795cfdf0a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1174415563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75eeddcb-3301-40fe-a7d5-2ff77893c026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d31c22b7548acb8770a1cc8b00d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:49Z,use_quota=True,user_id='090cc722934f4d5bacfb0c679238aab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ed3c46-108e-4531-9686-9e88c98ffbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4ed3c46-108e-4531-9686-9e88c98ffbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88631c13-0031-4391-bb8e-c1477783b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88631c13-0031-4391-bb8e-c1477783b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75eeddcb-3301-40fe-a7d5-2ff77893c026', 'volume_name': 'volume-75eeddcb-3301-40fe-a7d5-2ff77893c026', 'volume_size': 2}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cacd57-b3e8-4a87-aaf2-ecccbe98a014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3cacd57-b3e8-4a87-aaf2-ecccbe98a014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e4cb84-ee6b-44df-8829-b5e2a966e9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Volume 75eeddcb-3301-40fe-a7d5-2ff77893c026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75eeddcb-3301-40fe-a7d5-2ff77893c026', 'volume_size': 2} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1174415563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75eeddcb-3301-40fe-a7d5-2ff77893c026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357d31c22b7548acb8770a1cc8b00d15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:35:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:35:49Z,use_quota=True,user_id='090cc722934f4d5bacfb0c679238aab3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Creating volume 75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:35:49 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:35:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 2147483648 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:49 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 2147483648 Jun 23 04:35:49 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:50 devstack sudo[109506]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:50 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Deleted volume successfully. Jun 23 04:35:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9be54cd-08df-444e-bfda-ab093ae0c135 tempest-CinderUnicodeTest-656143041 None] Lock "cinder-a00b3463-6145-429e-8c17-fa9d5826a4ff-delete_volume" released by "delete_volume" :: held 2.729s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:35:50 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 2147483648" returned: 0 in 1.212s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:50 devstack sudo[109593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 Jun 23 04:35:50 devstack sudo[109593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:51 devstack sudo[109593]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026" returned: 0 in 0.735s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e4cb84-ee6b-44df-8829-b5e2a966e9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75eeddcb-3301-40fe-a7d5-2ff77893c026', 'volume_size': 2}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eaaf59-9fab-4d99-bf7e-1c49316c78d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:35:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Volume volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 (75eeddcb-3301-40fe-a7d5-2ff77893c026): created successfully Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01eaaf59-9fab-4d99-bf7e-1c49316c78d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:35:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Flow 'volume_create_manager' (e4385203-a568-41b4-a755-b70c70eab548) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:35:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ce08fbbe-839e-4a16-913e-038f0b61f1a3 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Created volume successfully. Jun 23 04:35:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Creating offline snapshot d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e of volume 75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:35:52 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cc20bf-4da3-4aa0-b365-58b8f61dd1ac]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:52 devstack sudo[109596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 Jun 23 04:35:52 devstack sudo[109596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:53 devstack sudo[109596]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026" returned: 0 in 0.837s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e 2G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:53 devstack sudo[109601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e 2G Jun 23 04:35:53 devstack sudo[109601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:54 devstack sudo[109601]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e 2G" returned: 0 in 0.880s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:54 devstack sudo[109607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e Jun 23 04:35:54 devstack sudo[109607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:54 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:35:54 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:55 devstack sudo[109607]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" returned: 0 in 0.829s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:55 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e is being set with open permissions: ugo+rw Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:55 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.768s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:35:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:35:55 devstack sudo[109615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e Jun 23 04:35:55 devstack sudo[109615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:56 devstack sudo[109615]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" returned: 0 in 0.700s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:56 devstack sudo[109618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info Jun 23 04:35:56 devstack sudo[109618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:56 devstack sudo[109618]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info" returned: 0 in 0.711s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:56 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info is being set with open permissions: ugo+rw Jun 23 04:35:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:56 devstack sudo[109621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info Jun 23 04:35:56 devstack sudo[109621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:57 devstack sudo[109621]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.info" returned: 0 in 0.808s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.866s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:35:57 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8f892161-ca9d-49a2-aece-8120ec669894 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Create snapshot completed successfully Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "cinder-d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "cinder-quobyte-75eeddcb-3301-40fe-a7d5-2ff77893c026" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-quobyte-75eeddcb-3301-40fe-a7d5-2ff77893c026" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "cinder-quobyte-d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-quobyte-d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Deleting offline snapshot d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e of volume 75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] snapshot_file for this snap is: volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af8a46-e7d7-4abe-bfc9-a3169463a7fd]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:58 devstack sudo[109624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e Jun 23 04:35:58 devstack sudo[109624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:35:59 devstack sudo[109624]: pam_unix(sudo:session): session closed for user root Jun 23 04:35:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" returned: 0 in 0.844s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:35:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-75eeddcb-3301-40fe-a7d5-2ff77893c026(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:35:59 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[919411bf-1ff6-4c0f-9db5-8f68f5f53961]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:35:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:35:59 devstack sudo[109631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 Jun 23 04:35:59 devstack sudo[109631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:00 devstack sudo[109631]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026" returned: 0 in 0.872s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:00 devstack sudo[109637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e Jun 23 04:36:00 devstack sudo[109637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:00 devstack sudo[109637]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" returned: 0 in 0.902s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:00 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e Jun 23 04:36:00 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:01 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026.d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" returned: 0 in 0.714s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-quobyte-d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e" released by "_delete_snapshot" :: held 3.481s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-quobyte-75eeddcb-3301-40fe-a7d5-2ff77893c026" released by "delete_snapshot" :: held 3.511s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:01 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Created reservations ['95f13b79-1386-435a-9093-f6c8d7dd3489', '121a42a9-1c0b-437d-b915-3118e652fd08', 'b4c8b6af-eb01-4741-9753-80c2da9ae3d6', '15c66fcb-2520-4ded-b6da-8a67f2776d27'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Delete snapshot completed successfully. Jun 23 04:36:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-8fc90797-24f5-4e47-9766-31d6d5300f3e tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-d3abdbaa-87e8-4ca4-9a27-76ffec5f1c5e-delete_snapshot" released by "delete_snapshot" :: held 3.677s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "cinder-75eeddcb-3301-40fe-a7d5-2ff77893c026-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-75eeddcb-3301-40fe-a7d5-2ff77893c026-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "cinder-quobyte-75eeddcb-3301-40fe-a7d5-2ff77893c026" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-quobyte-75eeddcb-3301-40fe-a7d5-2ff77893c026" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:02 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d863199f-472a-401a-9b99-230419b8c4ec]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:02 devstack sudo[109681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 Jun 23 04:36:02 devstack sudo[109681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:03 devstack sudo[109681]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026" returned: 0 in 0.865s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:03 devstack sudo[109686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026 Jun 23 04:36:03 devstack sudo[109686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:04 devstack sudo[109686]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-75eeddcb-3301-40fe-a7d5-2ff77893c026" returned: 0 in 0.776s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-quobyte-75eeddcb-3301-40fe-a7d5-2ff77893c026" released by "delete_volume" :: held 1.727s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Created reservations ['85438ceb-cef7-41ef-ac2f-cdc4e4c24964', '5408f5ca-3a19-43c9-9438-f6663bc5ae9c', 'abb4107d-de81-485f-a8e2-51aae5c43225', 'dd36ab7e-9b9a-417c-9d05-86129b9f0fe6'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:04 devstack sudo[109689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:04 devstack sudo[109689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:05 devstack sudo[109689]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.728s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:05 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Deleted volume successfully. Jun 23 04:36:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a72ddf88-f7aa-44a0-bf1d-48c84566d790 tempest-VolumesSnapshotNegativeTestJSON-948336759 None] Lock "cinder-75eeddcb-3301-40fe-a7d5-2ff77893c026-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53af3de-cee6-4cbc-bf4f-c30fedee7dc0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:08 devstack sudo[109707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 Jun 23 04:36:08 devstack sudo[109707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:09 devstack sudo[109707]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195" returned: 0 in 0.956s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.983s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-dbc2bcfb-b772-4722-9268-16d0f20c7195', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85dee006-073f-4fa1-8b25-d233fe7802ff', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:36:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-e8e79dce-4d08-4ac6-b0eb-7a140551d4c4 req-1b97d592-8cc7-4663-b9b2-9c1defa5fb00 tempest-TestInstancesWithCinderVolumes-1902325835 None] attachment_update completed successfully. Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Flow 'volume_create_manager' (79c8767b-b29e-44d7-99e3-0430cb6d7742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3420a8c-ac79-42cd-ad57-8abc43503398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3420a8c-ac79-42cd-ad57-8abc43503398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-790526484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b883b8-c994-45b3-96b1-c89bfdeb4920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8bbe5b57e044249783fcdbe2a18be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:36:16Z,use_quota=True,user_id='cddc7c68782f42acb47058e32c823dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac41a36-9a9b-4cca-908d-e9c267aa4b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ac41a36-9a9b-4cca-908d-e9c267aa4b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4479896e-3855-4c1f-8848-a62cafac28fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4479896e-3855-4c1f-8848-a62cafac28fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52b883b8-c994-45b3-96b1-c89bfdeb4920', 'volume_name': 'volume-52b883b8-c994-45b3-96b1-c89bfdeb4920', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f621252-2701-49a8-85e4-7f25e9a056a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f621252-2701-49a8-85e4-7f25e9a056a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de2b850-5896-4aac-a23c-f4f6357e6f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Volume 52b883b8-c994-45b3-96b1-c89bfdeb4920: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52b883b8-c994-45b3-96b1-c89bfdeb4920', 'volume_size': 1} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-790526484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b883b8-c994-45b3-96b1-c89bfdeb4920,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8bbe5b57e044249783fcdbe2a18be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:36:16Z,use_quota=True,user_id='cddc7c68782f42acb47058e32c823dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Creating volume 52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:36:15 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:36:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:15 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 1073741824 Jun 23 04:36:15 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:16 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 1073741824" returned: 0 in 1.050s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:17 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:17 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:17 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 0.738s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.839s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6de2b850-5896-4aac-a23c-f4f6357e6f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b883b8-c994-45b3-96b1-c89bfdeb4920', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d425ee9d-0f96-4890-860e-8a933af01a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Volume volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 (52b883b8-c994-45b3-96b1-c89bfdeb4920): created successfully Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d425ee9d-0f96-4890-860e-8a933af01a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Flow 'volume_create_manager' (79c8767b-b29e-44d7-99e3-0430cb6d7742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:36:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-81f09ee3-efc1-4069-94db-3de5be422801 tempest-SnapshotDependencyTests-2044453706 None] Created volume successfully. Jun 23 04:36:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca0397-a212-4ba6-8984-63330fa08fdb]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:18 devstack sudo[109745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 Jun 23 04:36:18 devstack sudo[109745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:19 devstack sudo[109745]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1" returned: 0 in 0.901s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.931s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.687s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Creating offline snapshot 0ba33104-5e59-4741-904c-5e8e0e61631f of volume 52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a96e91-b68e-4ac2-b7aa-95f0e7e33bac]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-ed47c78f-23f0-423d-af35-48dce20716c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a09fc5b7-b2e0-4a6b-9260-95dda41c3c4c', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:36:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-a6f4dcc9-2923-4d01-894e-ebe9f1da153e req-b02bc88b-bb37-4e51-b70e-34d1f4541164 tempest-TestInstancesWithCinderVolumes-1902325835 None] attachment_update completed successfully. Jun 23 04:36:19 devstack sudo[109751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:19 devstack sudo[109751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:19 devstack sudo[109751]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 0.862s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:19 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f 1G Jun 23 04:36:19 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:20 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f 1G" returned: 0 in 0.937s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:20 devstack sudo[109768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f Jun 23 04:36:20 devstack sudo[109768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:21 devstack sudo[109768]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:21 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f is being set with open permissions: ugo+rw Jun 23 04:36:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:21 devstack sudo[109774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f Jun 23 04:36:21 devstack sudo[109774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:22 devstack sudo[109774]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f" returned: 0 in 0.686s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:22 devstack sudo[109778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info Jun 23 04:36:22 devstack sudo[109778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:23 devstack sudo[109778]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info" returned: 0 in 0.650s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:23 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info is being set with open permissions: ugo+rw Jun 23 04:36:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:23 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info Jun 23 04:36:23 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:23 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.info" returned: 0 in 0.768s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.831s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:23 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-63b925b2-6980-4e89-8d22-4fea656de8c9 tempest-SnapshotDependencyTests-2044453706 None] Create snapshot completed successfully Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Flow 'volume_create_manager' (c21627e7-597a-4e53-9800-fe556f4e6ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d273eed-2c28-4f58-b443-0b785bfbec09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d273eed-2c28-4f58-b443-0b785bfbec09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:36:25Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc1a56cf-e851-4d44-aa02-199dd6af7e58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8bbe5b57e044249783fcdbe2a18be1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:36:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0ba33104-5e59-4741-904c-5e8e0e61631f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:36:25Z,use_quota=True,user_id='cddc7c68782f42acb47058e32c823dc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21d89b8-61e7-4014-b425-605f4ae6e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21d89b8-61e7-4014-b425-605f4ae6e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fedd9d9-eaf8-48ee-b29c-e8ca64ab579f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fedd9d9-eaf8-48ee-b29c-e8ca64ab579f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc1a56cf-e851-4d44-aa02-199dd6af7e58', 'volume_name': 'volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58', 'volume_size': 1, 'snapshot_id': '0ba33104-5e59-4741-904c-5e8e0e61631f'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae9ac83-7378-4cdf-9863-6b7c8efa0a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ae9ac83-7378-4cdf-9863-6b7c8efa0a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2676e2-50b1-4cd9-b658-528839ea9b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:25 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Volume dc1a56cf-e851-4d44-aa02-199dd6af7e58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58', 'volume_size': 1, 'snapshot_id': '0ba33104-5e59-4741-904c-5e8e0e61631f'} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-quobyte-0ba33104-5e59-4741-904c-5e8e0e61631f-dc1a56cf-e851-4d44-aa02-199dd6af7e58" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-0ba33104-5e59-4741-904c-5e8e0e61631f-dc1a56cf-e851-4d44-aa02-199dd6af7e58" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Creating volume dc1a56cf-e851-4d44-aa02-199dd6af7e58 from snapshot 0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-quobyte-dc1a56cf-e851-4d44-aa02-199dd6af7e58" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-dc1a56cf-e851-4d44-aa02-199dd6af7e58" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] snapshot: 0ba33104-5e59-4741-904c-5e8e0e61631f, volume: dc1a56cf-e851-4d44-aa02-199dd6af7e58, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b032010b-2c09-42ee-bea3-cb5589bb8505]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:25 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f Jun 23 04:36:25 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:26 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f" returned: 0 in 0.972s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b883b8-c994-45b3-96b1-c89bfdeb4920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:36:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:36:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:36:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[59000f24-0f32-43e3-9175-008ab3eb5eea]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:26 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:26 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:27 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 0.857s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:27 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:36:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:27 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 Jun 23 04:36:27 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:30 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=78,cinder:UPDATE=89,cinder:INSERT=19,cinder:DELETE=9 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:36:30 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=86,cinder:UPDATE=88,cinder:INSERT=25,cinder:DELETE=5 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:36:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-bb17bb6a-6d2c-47c3-980e-1d74db639691 req-bd0e9759-b397-4deb-901f-422ffc9acaf4 tempest-TestInstancesWithCinderVolumes-1902325835 None] Terminate volume connection completed successfully. Jun 23 04:36:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-bb17bb6a-6d2c-47c3-980e-1d74db639691 req-bd0e9759-b397-4deb-901f-422ffc9acaf4 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deleting attachment 85dee006-073f-4fa1-8b25-d233fe7802ff. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:36:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "cinder-dbc2bcfb-b772-4722-9268-16d0f20c7195-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-dbc2bcfb-b772-4722-9268-16d0f20c7195-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "cinder-quobyte-dbc2bcfb-b772-4722-9268-16d0f20c7195" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-quobyte-dbc2bcfb-b772-4722-9268-16d0f20c7195" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee8f243-450a-4166-a4bc-ad995652017b]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:32 devstack sudo[109852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 Jun 23 04:36:32 devstack sudo[109852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:33 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58" returned: 0 in 6.162s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9393114-9874-4509-9d17-95b03830ddf3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:33 devstack sudo[109855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:33 devstack sudo[109855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:34 devstack sudo[109852]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195" returned: 0 in 1.810s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:34 devstack sudo[109861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195 Jun 23 04:36:34 devstack sudo[109861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:35 devstack sudo[109861]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dbc2bcfb-b772-4722-9268-16d0f20c7195" returned: 0 in 0.988s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:35 devstack sudo[109855]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 1.439s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:36:35 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Converted 1024.00 MB image at 166.13 MB/s Jun 23 04:36:35 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 is being set with open permissions: ugo+rw Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-quobyte-dbc2bcfb-b772-4722-9268-16d0f20c7195" released by "delete_volume" :: held 2.941s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:35 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 Jun 23 04:36:35 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:35 devstack cinder-volume[93326]: WARNING cinder.quota [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-627193369-1292191143 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-627193369-1292191143, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:36:35 devstack cinder-volume[93326]: WARNING cinder.quota [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-627193369-1292191143 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-627193369-1292191143, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Created reservations ['1240af37-7a13-4e42-a59d-9806e302f03e', '64b23d6c-2bcc-4528-96bd-6f3e4113973b', 'f35968b0-7012-4806-9014-283de028137b', 'cc6bb4d6-bc48-44b8-808f-b6bf85362dc0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:35 devstack sudo[109875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:35 devstack sudo[109875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:36 devstack sudo[109875]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.940s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:36 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deleted volume successfully. Jun 23 04:36:36 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58" returned: 0 in 1.215s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1e65d539-8f0b-4b7c-a3e9-22966935cfe5 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-dbc2bcfb-b772-4722-9268-16d0f20c7195-delete_volume" released by "delete_volume" :: held 4.241s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-dc1a56cf-e851-4d44-aa02-199dd6af7e58" released by "_copy_volume_from_snapshot" :: held 10.794s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-0ba33104-5e59-4741-904c-5e8e0e61631f-dc1a56cf-e851-4d44-aa02-199dd6af7e58" released by "_create_volume_from_snapshot" :: held 10.855s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.874s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2676e2-50b1-4cd9-b658-528839ea9b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58', 'volume_size': 1, 'snapshot_id': '0ba33104-5e59-4741-904c-5e8e0e61631f'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49bdbb0-0be5-4056-869f-f75419c764b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:36:36 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Volume volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 (dc1a56cf-e851-4d44-aa02-199dd6af7e58): created successfully Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49bdbb0-0be5-4056-869f-f75419c764b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:36:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Flow 'volume_create_manager' (c21627e7-597a-4e53-9800-fe556f4e6ad3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:36:36 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-14dea384-e436-435d-aa47-0730cff3fc43 tempest-SnapshotDependencyTests-2044453706 None] Created volume successfully. Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-0ba33104-5e59-4741-904c-5e8e0e61631f-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-0ba33104-5e59-4741-904c-5e8e0e61631f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-quobyte-52b883b8-c994-45b3-96b1-c89bfdeb4920" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-52b883b8-c994-45b3-96b1-c89bfdeb4920" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-quobyte-0ba33104-5e59-4741-904c-5e8e0e61631f" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-0ba33104-5e59-4741-904c-5e8e0e61631f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Deleting offline snapshot 0ba33104-5e59-4741-904c-5e8e0e61631f of volume 52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] snapshot_file for this snap is: volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f946bc96-fc12-4892-9af0-050330b7c556]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:37 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f Jun 23 04:36:37 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:38 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-e1041edf-6848-476b-96bb-5e66036b1823 req-e6686ea2-a2f5-4d4c-9736-7b779c7696f7 tempest-TestInstancesWithCinderVolumes-1902325835 None] Terminate volume connection completed successfully. Jun 23 04:36:38 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-e1041edf-6848-476b-96bb-5e66036b1823 req-e6686ea2-a2f5-4d4c-9736-7b779c7696f7 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deleting attachment a09fc5b7-b2e0-4a6b-9260-95dda41c3c4c. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:36:38 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f" returned: 0 in 0.900s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:38 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52b883b8-c994-45b3-96b1-c89bfdeb4920(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:36:38 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33ffda0-cb3a-4efd-8ea7-5b61a5abc44f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:38 devstack sudo[109905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:38 devstack sudo[109905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:39 devstack sudo[109905]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 0.840s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:39 devstack sudo[109910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f Jun 23 04:36:39 devstack sudo[109910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "cinder-ed47c78f-23f0-423d-af35-48dce20716c1-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-ed47c78f-23f0-423d-af35-48dce20716c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "cinder-quobyte-ed47c78f-23f0-423d-af35-48dce20716c1" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-quobyte-ed47c78f-23f0-423d-af35-48dce20716c1" acquired by "delete_volume" :: waited 0.033s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a95353e-2a70-4674-aec5-a0a3dcc6ca39]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:40 devstack sudo[109915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 Jun 23 04:36:40 devstack sudo[109915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:40 devstack sudo[109910]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f" returned: 0 in 0.855s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:40 devstack sudo[109917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f Jun 23 04:36:40 devstack sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:40 devstack sudo[109915]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1" returned: 0 in 0.894s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:41 devstack sudo[109922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1 Jun 23 04:36:41 devstack sudo[109922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:41 devstack sudo[109917]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920.0ba33104-5e59-4741-904c-5e8e0e61631f" returned: 0 in 0.927s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-0ba33104-5e59-4741-904c-5e8e0e61631f" released by "_delete_snapshot" :: held 3.699s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-52b883b8-c994-45b3-96b1-c89bfdeb4920" released by "delete_snapshot" :: held 3.743s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Created reservations ['37d3d057-c671-41cd-a1a6-38b5264a6be5', '637b5eba-0acd-484b-9ebd-2ef683166580', '2eb1f91c-8174-4136-bdca-44cd05fc450b', '7beff536-19e4-4459-a28a-76eb26fa4b15'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:41 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Delete snapshot completed successfully. Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2b143282-6ab4-42bb-9967-a179d2c43cca tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-0ba33104-5e59-4741-904c-5e8e0e61631f-delete_snapshot" released by "delete_snapshot" :: held 4.006s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-52b883b8-c994-45b3-96b1-c89bfdeb4920-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-52b883b8-c994-45b3-96b1-c89bfdeb4920-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:41 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-quobyte-52b883b8-c994-45b3-96b1-c89bfdeb4920" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:42 devstack sudo[109922]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-52b883b8-c994-45b3-96b1-c89bfdeb4920" acquired by "delete_volume" :: waited 0.044s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ed47c78f-23f0-423d-af35-48dce20716c1" returned: 0 in 1.058s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae68925-1d2e-4ecd-929f-293395935a1d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-quobyte-ed47c78f-23f0-423d-af35-48dce20716c1" released by "delete_volume" :: held 2.040s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477045138-85738439 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477045138-85738439, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:36:42 devstack cinder-volume[93326]: WARNING cinder.quota [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477045138-85738439 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477045138-85738439, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Created reservations ['c82d4e76-8816-461e-b91a-f2069a84a356', 'a73a7227-9830-4e2c-a6ec-7749d57c1643', 'e0eb099e-324e-4bc8-b1fb-d4ad4ad5b91e', '27f0d10b-7e09-4202-8e5e-c0f132051dff'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:42 devstack sudo[109927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:42 devstack sudo[109927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:42 devstack sudo[109929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:42 devstack sudo[109929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:43 devstack sudo[109927]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 1.186s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:43 devstack sudo[109929]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.920s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:43 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:43 devstack sudo[109945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920 Jun 23 04:36:43 devstack sudo[109945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:43 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Deleted volume successfully. Jun 23 04:36:43 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-47553531-0093-4bc3-9351-ffe9cc0abf0a tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-ed47c78f-23f0-423d-af35-48dce20716c1-delete_volume" released by "delete_volume" :: held 3.363s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:44 devstack sudo[109945]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-52b883b8-c994-45b3-96b1-c89bfdeb4920" returned: 0 in 0.818s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-52b883b8-c994-45b3-96b1-c89bfdeb4920" released by "delete_volume" :: held 2.103s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Created reservations ['ee3bcb2a-b106-4df7-a408-b3317fcb8b25', '5a8f735f-69b1-4685-8e7e-cc8ed04a18e4', 'ad6db93e-06c9-4aa4-8928-de4440098396', '71d28f45-1b4c-4749-b2c2-38fc8db9c086'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:44 devstack sudo[109951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:44 devstack sudo[109951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-dc1a56cf-e851-4d44-aa02-199dd6af7e58-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-dc1a56cf-e851-4d44-aa02-199dd6af7e58-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:45 devstack sudo[109951]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.114s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:45 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Deleted volume successfully. Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "cinder-quobyte-dc1a56cf-e851-4d44-aa02-199dd6af7e58" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-dc1a56cf-e851-4d44-aa02-199dd6af7e58" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c25267de-7760-4516-a49f-377a83b634a0 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-52b883b8-c994-45b3-96b1-c89bfdeb4920-delete_volume" released by "delete_volume" :: held 3.558s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e47aa7-ae6c-4617-bdc4-5d5f3b35ebc9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:45 devstack sudo[109995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 Jun 23 04:36:45 devstack sudo[109995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:46 devstack sudo[109995]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58" returned: 0 in 0.906s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:46 devstack sudo[110002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58 Jun 23 04:36:46 devstack sudo[110002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:47 devstack sudo[110002]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-dc1a56cf-e851-4d44-aa02-199dd6af7e58" returned: 0 in 0.716s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-quobyte-dc1a56cf-e851-4d44-aa02-199dd6af7e58" released by "delete_volume" :: held 1.678s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Created reservations ['d8f0100d-b4d7-4059-b622-7fc1b3c1565c', '354f3af9-047d-4e5f-a854-2da2a54d82ef', 'd4dc761e-5876-4564-9c03-d4520afd8607', '133b05e5-5c42-4c11-956e-491016fd75de'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:47 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:47 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:47 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-13844593-9146-4a97-bc22-c3ff5497a9cc req-1850f462-c10e-47d5-8166-6010ef14da52 tempest-TestInstancesWithCinderVolumes-1902325835 None] Terminate volume connection completed successfully. Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-13844593-9146-4a97-bc22-c3ff5497a9cc req-1850f462-c10e-47d5-8166-6010ef14da52 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deleting attachment 472cc56a-d9a6-4a2e-aebd-094dbe273e14. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:36:47 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.711s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:47 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Deleted volume successfully. Jun 23 04:36:47 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a2e014c9-f667-4b12-b9ca-658badcea0e4 tempest-SnapshotDependencyTests-2044453706 None] Lock "cinder-dc1a56cf-e851-4d44-aa02-199dd6af7e58-delete_volume" released by "delete_volume" :: held 2.629s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "cinder-6563f088-844f-453f-ba1d-8d0588e76fea-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-6563f088-844f-453f-ba1d-8d0588e76fea-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "cinder-quobyte-6563f088-844f-453f-ba1d-8d0588e76fea" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:36:51 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-quobyte-6563f088-844f-453f-ba1d-8d0588e76fea" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:36:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b21835-ae53-4b88-9e39-907f38f10448]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:36:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:51 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:36:51 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:52 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 0 in 1.118s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:52 devstack sudo[110039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:36:52 devstack sudo[110039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:53 devstack sudo[110039]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 1 in 0.902s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:36:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:53 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea Jun 23 04:36:53 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:54 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-6563f088-844f-453f-ba1d-8d0588e76fea" returned: 0 in 0.750s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-quobyte-6563f088-844f-453f-ba1d-8d0588e76fea" released by "delete_volume" :: held 2.892s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:36:54 devstack cinder-volume[93326]: WARNING cinder.quota [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422664429-1491266482 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422664429-1491266482, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:36:54 devstack cinder-volume[93326]: WARNING cinder.quota [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422664429-1491266482 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-422664429-1491266482, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Created reservations ['e44fafdc-365a-46a3-88e5-7cee7cda08ca', 'b508827a-578b-49af-a451-b844a84f6703', '2aa31307-1f84-4d7b-adc4-9d513b014cec', '61f5a54e-1c8a-4575-8b94-8db512f5443b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:54 devstack sudo[110065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:54 devstack sudo[110065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:36:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:36:54 devstack sudo[110067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:36:54 devstack sudo[110067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:36:55 devstack sudo[110065]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.753s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:55 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Deleted volume successfully. Jun 23 04:36:55 devstack sudo[110067]: pam_unix(sudo:session): session closed for user root Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:36:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b28b8b00-0290-41fc-8ae3-e5c443bd7773 tempest-TestInstancesWithCinderVolumes-1902325835 None] Lock "cinder-6563f088-844f-453f-ba1d-8d0588e76fea-delete_volume" released by "delete_volume" :: held 3.981s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Flow 'volume_create_manager' (fb4b9834-1062-414d-a04b-466cfc4554c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d3ba59-77d0-45d3-a5e8-e31e029c8b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22d3ba59-77d0-45d3-a5e8-e31e029c8b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1870684346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e24951d-9093-48a3-91a3-9ee7aceed314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b455f31c8cf84810b6ede3d55cb2f2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:03Z,use_quota=True,user_id='ab1aa632012e4a278fbe386fccb2d65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51b3a02-6ef2-4ce4-8935-e4a5b19c78b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e51b3a02-6ef2-4ce4-8935-e4a5b19c78b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36bea3-eace-4d8b-86e7-6eaa92e88ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36bea3-eace-4d8b-86e7-6eaa92e88ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e24951d-9093-48a3-91a3-9ee7aceed314', 'volume_name': 'volume-8e24951d-9093-48a3-91a3-9ee7aceed314', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de41b8dc-4f0e-45c3-8ff2-c877df18d566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de41b8dc-4f0e-45c3-8ff2-c877df18d566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd471707-7459-40ce-91b8-67e3107e28a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:03 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Volume 8e24951d-9093-48a3-91a3-9ee7aceed314: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e24951d-9093-48a3-91a3-9ee7aceed314', 'volume_size': 1} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1870684346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e24951d-9093-48a3-91a3-9ee7aceed314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b455f31c8cf84810b6ede3d55cb2f2fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:03Z,use_quota=True,user_id='ab1aa632012e4a278fbe386fccb2d65d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Creating volume 8e24951d-9093-48a3-91a3-9ee7aceed314 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:03 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:03 devstack sudo[110197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 1073741824 Jun 23 04:37:03 devstack sudo[110197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:04 devstack sudo[110197]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 1073741824" returned: 0 in 1.021s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:04 devstack sudo[110204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 Jun 23 04:37:04 devstack sudo[110204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:05 devstack sudo[110204]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314" returned: 0 in 0.861s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.941s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd471707-7459-40ce-91b8-67e3107e28a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e24951d-9093-48a3-91a3-9ee7aceed314', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527b770a-9d99-498f-b0d2-985084aae241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:05 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Volume volume-8e24951d-9093-48a3-91a3-9ee7aceed314 (8e24951d-9093-48a3-91a3-9ee7aceed314): created successfully Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527b770a-9d99-498f-b0d2-985084aae241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Flow 'volume_create_manager' (fb4b9834-1062-414d-a04b-466cfc4554c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7a0f70c3-dd78-490f-8925-01e1959d4f34 tempest-TestMinimumBasicScenario-431768569 None] Created volume successfully. Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (385b875d-4264-4648-b863-763ec1b23c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464c42b1-c61b-4b1b-8f23-ec989c6d0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464c42b1-c61b-4b1b-8f23-ec989c6d0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-166863846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e272f3-e844-47b2-8ebc-e44753d54d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:09Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171404fe-20bd-45f0-bc8f-079828a25488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (171404fe-20bd-45f0-bc8f-079828a25488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1f0045-3a1b-4806-a188-059d188fbabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1f0045-3a1b-4806-a188-059d188fbabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e272f3-e844-47b2-8ebc-e44753d54d3f', 'volume_name': 'volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a39fa3f-07b3-418b-8d6c-30a5326e59b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a39fa3f-07b3-418b-8d6c-30a5326e59b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcabe3f-d7f3-4529-886b-3866a545d9dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:09 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume b8e272f3-e844-47b2-8ebc-e44753d54d3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f', 'volume_size': 1} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-166863846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e272f3-e844-47b2-8ebc-e44753d54d3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:09Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Creating volume b8e272f3-e844-47b2-8ebc-e44753d54d3f {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:09 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:09 devstack sudo[110215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f 1073741824 Jun 23 04:37:09 devstack sudo[110215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:10 devstack sudo[110215]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f 1073741824" returned: 0 in 0.913s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:10 devstack sudo[110225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f Jun 23 04:37:10 devstack sudo[110225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:11 devstack sudo[110225]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f" returned: 0 in 0.706s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.429s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dcabe3f-d7f3-4529-886b-3866a545d9dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4818d9b3-d784-4767-b656-306f4b59b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d829cb-f2fc-4aaa-ab4b-7b919c284aa8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:11 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f (b8e272f3-e844-47b2-8ebc-e44753d54d3f): created successfully Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4818d9b3-d784-4767-b656-306f4b59b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:11 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (385b875d-4264-4648-b863-763ec1b23c77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:11 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b03f69b8-722e-44b6-a276-8cbade362adc tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created volume successfully. Jun 23 04:37:11 devstack sudo[110242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 Jun 23 04:37:11 devstack sudo[110242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (8a3cbe97-64b2-4e89-8824-b8e3df185368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070155b3-83c1-44c7-acf7-cc68900a457c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (070155b3-83c1-44c7-acf7-cc68900a457c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799720186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d899a387-9deb-4f97-adce-ac09dbea1061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:12Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849dcb32-b056-4e83-aa52-d716c269ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (849dcb32-b056-4e83-aa52-d716c269ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78733ad-735c-44be-b3db-b718eb810fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78733ad-735c-44be-b3db-b718eb810fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd899a387-9deb-4f97-adce-ac09dbea1061', 'volume_name': 'volume-d899a387-9deb-4f97-adce-ac09dbea1061', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9052749c-0a5f-4b3b-8542-53bfcc480815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9052749c-0a5f-4b3b-8542-53bfcc480815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20aa549e-4b5f-484b-8ef2-73b5beccbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume d899a387-9deb-4f97-adce-ac09dbea1061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d899a387-9deb-4f97-adce-ac09dbea1061', 'volume_size': 1} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:12 devstack sudo[110242]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314" returned: 0 in 0.887s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.920s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799720186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d899a387-9deb-4f97-adce-ac09dbea1061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:12Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Creating volume d899a387-9deb-4f97-adce-ac09dbea1061 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:12 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:12 devstack sudo[110247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 1073741824 Jun 23 04:37:12 devstack sudo[110247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-8e24951d-9093-48a3-91a3-9ee7aceed314', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4bcb69b-ab92-4c80-8955-3dd124da6bd4', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:37:12 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-e40b8b93-1154-46e4-9148-03cdc648b649 req-23c4bc7b-3b5e-4582-8e1f-f0af99379fb3 tempest-TestMinimumBasicScenario-431768569 None] attachment_update completed successfully. Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (00d407dc-8a87-4ebf-80c5-23368a875045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c006a27-b32b-4e47-8f31-1dce9053720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c006a27-b32b-4e47-8f31-1dce9053720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1325911098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85abb4cc-9a8c-405e-acc2-aecb4d6878e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:12Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981775c8-d50c-4d35-b71b-a3a8b6de5096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981775c8-d50c-4d35-b71b-a3a8b6de5096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899db729-6058-49ef-81ad-0d1094aef46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899db729-6058-49ef-81ad-0d1094aef46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85abb4cc-9a8c-405e-acc2-aecb4d6878e0', 'volume_name': 'volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7a397d-970d-4244-801f-af9d5260bf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b7a397d-970d-4244-801f-af9d5260bf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34947e11-4679-4ad5-8bb5-048382bd04e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume 85abb4cc-9a8c-405e-acc2-aecb4d6878e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0', 'volume_size': 1} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (d821f397-74f7-4bc5-99e9-b30100bbfe00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4463cc-4d3d-4d1d-86bb-b7d5a412542b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b4463cc-4d3d-4d1d-86bb-b7d5a412542b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602875668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c529f67e-3ca9-463c-b2ef-01be48081d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:13Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dfe8d4-05e5-40aa-bba3-b11421285687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3dfe8d4-05e5-40aa-bba3-b11421285687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f7692a-2638-4914-9a6b-bc8f76b7bc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58f7692a-2638-4914-9a6b-bc8f76b7bc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c529f67e-3ca9-463c-b2ef-01be48081d7d', 'volume_name': 'volume-c529f67e-3ca9-463c-b2ef-01be48081d7d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f72507b-25b9-42a0-90c5-f75396e8dc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f72507b-25b9-42a0-90c5-f75396e8dc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3095c23c-c90f-4118-af38-bfc08d78b2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:12 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume c529f67e-3ca9-463c-b2ef-01be48081d7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c529f67e-3ca9-463c-b2ef-01be48081d7d', 'volume_size': 1} Jun 23 04:37:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:13 devstack sudo[110247]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (ea30c7ad-e31a-4624-a846-42438b9bbcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc27ed6-984d-4aac-9d3f-058d2e4cd679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 1073741824" returned: 0 in 1.094s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc27ed6-984d-4aac-9d3f-058d2e4cd679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129374977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4875f051-2b20-42e6-9e96-8a88d0e33fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:13Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44990664-6279-4f1f-9e24-05f4fcec4219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44990664-6279-4f1f-9e24-05f4fcec4219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251fce9e-7f92-45bb-975b-fd30f70d946d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (251fce9e-7f92-45bb-975b-fd30f70d946d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4875f051-2b20-42e6-9e96-8a88d0e33fef', 'volume_name': 'volume-4875f051-2b20-42e6-9e96-8a88d0e33fef', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf314e75-965a-44d9-8b22-a5569e5dd07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf314e75-965a-44d9-8b22-a5569e5dd07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d21ddb2-8e14-4329-b86a-b382c9ec2575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume 4875f051-2b20-42e6-9e96-8a88d0e33fef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4875f051-2b20-42e6-9e96-8a88d0e33fef', 'volume_size': 1} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:13 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 Jun 23 04:37:13 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (3a55776f-e707-437d-b67d-a4ccf226db95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b0e914-7c95-43b1-9d18-3021ceb5c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8b0e914-7c95-43b1-9d18-3021ceb5c236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641285150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d227a010-8335-4fb7-8543-074d8ae716fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:14Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c1963e-e138-427d-a3d6-c6f874f9e8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9c1963e-e138-427d-a3d6-c6f874f9e8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd91573-6a5b-4c46-b9b2-841517a34aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebd91573-6a5b-4c46-b9b2-841517a34aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd227a010-8335-4fb7-8543-074d8ae716fc', 'volume_name': 'volume-d227a010-8335-4fb7-8543-074d8ae716fc', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39eb587-261b-4d61-80ed-f589f7006c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b39eb587-261b-4d61-80ed-f589f7006c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2774cd-56c4-4285-93df-be39636b2e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:13 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume d227a010-8335-4fb7-8543-074d8ae716fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d227a010-8335-4fb7-8543-074d8ae716fc', 'volume_size': 1} Jun 23 04:37:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:14 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061" returned: 0 in 0.686s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.880s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1325911098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85abb4cc-9a8c-405e-acc2-aecb4d6878e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:12Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Creating volume 85abb4cc-9a8c-405e-acc2-aecb4d6878e0 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:14 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20aa549e-4b5f-484b-8ef2-73b5beccbbce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d899a387-9deb-4f97-adce-ac09dbea1061', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:14 devstack sudo[110641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 1073741824 Jun 23 04:37:14 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a6a497-158e-4bd8-bf6f-3275d4091c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:14 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume volume-d899a387-9deb-4f97-adce-ac09dbea1061 (d899a387-9deb-4f97-adce-ac09dbea1061): created successfully Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43a6a497-158e-4bd8-bf6f-3275d4091c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:14 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (8a3cbe97-64b2-4e89-8824-b8e3df185368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-88b5044a-87d5-483b-b6d1-7ac465eec80b tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created volume successfully. Jun 23 04:37:15 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 1073741824" returned: 0 in 0.868s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:15 devstack sudo[110647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 Jun 23 04:37:15 devstack sudo[110647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:15 devstack sudo[110647]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0" returned: 0 in 0.651s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.559s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.738s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1602875668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c529f67e-3ca9-463c-b2ef-01be48081d7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:13Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Creating volume c529f67e-3ca9-463c-b2ef-01be48081d7d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:15 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:15 devstack sudo[110650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d 1073741824 Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34947e11-4679-4ad5-8bb5-048382bd04e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:15 devstack sudo[110650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a38d91c-f628-4c58-bace-fa7a94ebb96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 (85abb4cc-9a8c-405e-acc2-aecb4d6878e0): created successfully Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a38d91c-f628-4c58-bace-fa7a94ebb96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (00d407dc-8a87-4ebf-80c5-23368a875045) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6f714813-d29b-4061-bc75-a75ed48c4906 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created volume successfully. Jun 23 04:37:16 devstack sudo[110650]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d 1073741824" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:16 devstack sudo[110656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d Jun 23 04:37:16 devstack sudo[110656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:17 devstack sudo[110656]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d" returned: 0 in 0.680s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.836s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-129374977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4875f051-2b20-42e6-9e96-8a88d0e33fef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:13Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Creating volume 4875f051-2b20-42e6-9e96-8a88d0e33fef {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:17 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3095c23c-c90f-4118-af38-bfc08d78b2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c529f67e-3ca9-463c-b2ef-01be48081d7d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ce9efb-85e4-49a6-a7c3-b3b167987e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:17 devstack sudo[110659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef 1073741824 Jun 23 04:37:17 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume volume-c529f67e-3ca9-463c-b2ef-01be48081d7d (c529f67e-3ca9-463c-b2ef-01be48081d7d): created successfully Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30ce9efb-85e4-49a6-a7c3-b3b167987e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (d821f397-74f7-4bc5-99e9-b30100bbfe00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a69b9bcf-35ee-4ffa-96c8-8b2c3ff0e3eb tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created volume successfully. Jun 23 04:37:18 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef 1073741824" returned: 0 in 1.045s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:18 devstack sudo[110665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef Jun 23 04:37:18 devstack sudo[110665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:19 devstack sudo[110665]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef" returned: 0 in 0.721s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.335s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-641285150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d227a010-8335-4fb7-8543-074d8ae716fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95a035e6371042d98b04e5a78dd01cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:14Z,use_quota=True,user_id='14dca95189f1479fb02b014edad64f11',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Creating volume d227a010-8335-4fb7-8543-074d8ae716fc {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:19 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:19 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc 1073741824 Jun 23 04:37:19 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d21ddb2-8e14-4329-b86a-b382c9ec2575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4875f051-2b20-42e6-9e96-8a88d0e33fef', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f726d-bf2b-402f-9ed6-fd31f2885f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:19 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume volume-4875f051-2b20-42e6-9e96-8a88d0e33fef (4875f051-2b20-42e6-9e96-8a88d0e33fef): created successfully Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (164f726d-bf2b-402f-9ed6-fd31f2885f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (ea30c7ad-e31a-4624-a846-42438b9bbcc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5523be50-a2ed-49e5-96c4-c9683507a1d0 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created volume successfully. Jun 23 04:37:20 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc 1073741824" returned: 0 in 1.109s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:20 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc Jun 23 04:37:20 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:21 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2774cd-56c4-4285-93df-be39636b2e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d227a010-8335-4fb7-8543-074d8ae716fc', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd109b41-2c8f-4156-ad37-6a60f7dd7c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:21 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Volume volume-d227a010-8335-4fb7-8543-074d8ae716fc (d227a010-8335-4fb7-8543-074d8ae716fc): created successfully Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd109b41-2c8f-4156-ad37-6a60f7dd7c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Flow 'volume_create_manager' (3a55776f-e707-437d-b67d-a4ccf226db95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:21 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-24947722-eb4a-4dca-badd-4c80a9efb477 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created volume successfully. Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-d227a010-8335-4fb7-8543-074d8ae716fc-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-d227a010-8335-4fb7-8543-074d8ae716fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-quobyte-d227a010-8335-4fb7-8543-074d8ae716fc" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-d227a010-8335-4fb7-8543-074d8ae716fc" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[395891e7-d9a4-4ac9-9ead-289a450b767c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:22 devstack sudo[110685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc Jun 23 04:37:22 devstack sudo[110685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:22 devstack sudo[110685]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc" returned: 0 in 0.789s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:22 devstack sudo[110691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc Jun 23 04:37:22 devstack sudo[110691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:23 devstack sudo[110691]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d227a010-8335-4fb7-8543-074d8ae716fc" returned: 0 in 0.680s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-d227a010-8335-4fb7-8543-074d8ae716fc" released by "delete_volume" :: held 1.516s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created reservations ['f4dc2be2-e368-4bec-a3ca-2d35de810a58', '095c3068-8903-4c61-b147-fa97e8371a22', 'd8f2058b-0724-4be4-9cf4-b77ed823e3ee', '9ef27547-3a91-4a9a-a2e4-2189b9be27bc'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:23 devstack sudo[110697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:23 devstack sudo[110697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-4875f051-2b20-42e6-9e96-8a88d0e33fef-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-4875f051-2b20-42e6-9e96-8a88d0e33fef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-quobyte-4875f051-2b20-42e6-9e96-8a88d0e33fef" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-4875f051-2b20-42e6-9e96-8a88d0e33fef" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85c41eb-d268-4653-941d-df1b24d3a0f5]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:24 devstack sudo[110697]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.732s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Deleted volume successfully. Jun 23 04:37:24 devstack sudo[110700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef Jun 23 04:37:24 devstack sudo[110700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-71a50240-642e-4212-8f94-bd76b6efa5b7 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-d227a010-8335-4fb7-8543-074d8ae716fc-delete_volume" released by "delete_volume" :: held 2.475s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:24 devstack sudo[110700]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef" returned: 0 in 0.791s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:24 devstack sudo[110706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef Jun 23 04:37:24 devstack sudo[110706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:25 devstack sudo[110706]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-4875f051-2b20-42e6-9e96-8a88d0e33fef" returned: 0 in 0.647s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-4875f051-2b20-42e6-9e96-8a88d0e33fef" released by "delete_volume" :: held 1.478s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created reservations ['0ae4d18b-22db-4261-b5bd-9897ca4c885b', '8d813804-f9a1-4286-b9d7-4daea43d0919', '474db99a-b4f4-4294-b012-6317cadda470', 'a66b61ea-5a8f-4f68-ad56-c89f13ae232d'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:25 devstack sudo[110709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:25 devstack sudo[110709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-c529f67e-3ca9-463c-b2ef-01be48081d7d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-c529f67e-3ca9-463c-b2ef-01be48081d7d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-quobyte-c529f67e-3ca9-463c-b2ef-01be48081d7d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-c529f67e-3ca9-463c-b2ef-01be48081d7d" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:26 devstack sudo[110709]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.661s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Deleted volume successfully. Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc537d-b911-4b99-bdaa-5261f819befe]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aef6ae9c-a0e6-44e5-b325-f1b0e427a721 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-4875f051-2b20-42e6-9e96-8a88d0e33fef-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:26 devstack sudo[110712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d Jun 23 04:37:26 devstack sudo[110712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:27 devstack sudo[110712]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:27 devstack sudo[110717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d Jun 23 04:37:27 devstack sudo[110717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:27 devstack sudo[110717]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-c529f67e-3ca9-463c-b2ef-01be48081d7d" returned: 0 in 0.644s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-c529f67e-3ca9-463c-b2ef-01be48081d7d" released by "delete_volume" :: held 1.433s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created reservations ['c3563bf1-4467-40ef-be5c-18d3a2bfb508', 'efb7135a-5939-49e0-a5a0-fa0ffb540533', '7136e725-4ba0-40f3-b60e-cf7f9ba8a0fc', '83c8e0bb-a785-4aff-88c3-703590e617d4'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:27 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:27 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-85abb4cc-9a8c-405e-acc2-aecb4d6878e0-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-85abb4cc-9a8c-405e-acc2-aecb4d6878e0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:28 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.675s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:28 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Deleted volume successfully. Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-quobyte-85abb4cc-9a8c-405e-acc2-aecb4d6878e0" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-85abb4cc-9a8c-405e-acc2-aecb4d6878e0" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3ef14942-fa37-4b64-9428-51aeaca8e90a tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-c529f67e-3ca9-463c-b2ef-01be48081d7d-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb51e2c-8b68-4846-b80e-48b9bf99b0ab]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:28 devstack sudo[110726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 Jun 23 04:37:28 devstack sudo[110726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:29 devstack sudo[110726]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0" returned: 0 in 0.747s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:29 devstack sudo[110731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0 Jun 23 04:37:29 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:30 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-85abb4cc-9a8c-405e-acc2-aecb4d6878e0" returned: 0 in 0.655s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-85abb4cc-9a8c-405e-acc2-aecb4d6878e0" released by "delete_volume" :: held 1.449s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created reservations ['a162fd3b-8fdd-4bdc-a3c3-07bda8ca610e', '8140bdac-ed50-4501-8c27-dbb57a853667', 'a0955218-d55e-47c7-a4ef-65b215122ba3', 'e7f3f2de-3a9c-451c-88cf-09d2f111f58d'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:30 devstack sudo[110734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:30 devstack sudo[110734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-d899a387-9deb-4f97-adce-ac09dbea1061-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-d899a387-9deb-4f97-adce-ac09dbea1061-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=66,cinder:UPDATE=108,cinder:INSERT=21,cinder:DELETE=8 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=80,cinder:INSERT=26,cinder:UPDATE=96,cinder:DELETE=8 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-quobyte-d899a387-9deb-4f97-adce-ac09dbea1061" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-d899a387-9deb-4f97-adce-ac09dbea1061" acquired by "delete_volume" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:30 devstack sudo[110734]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c345cf4-3bf6-4526-bc13-32383b84852f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Deleted volume successfully. Jun 23 04:37:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-886d1753-63d4-4913-8ea9-3ef13f5ee774 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-85abb4cc-9a8c-405e-acc2-aecb4d6878e0-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:30 devstack sudo[110737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 Jun 23 04:37:30 devstack sudo[110737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:31 devstack sudo[110737]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061" returned: 0 in 0.780s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:31 devstack sudo[110742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061 Jun 23 04:37:31 devstack sudo[110742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:32 devstack sudo[110742]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d899a387-9deb-4f97-adce-ac09dbea1061" returned: 0 in 0.670s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-d899a387-9deb-4f97-adce-ac09dbea1061" released by "delete_volume" :: held 1.503s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created reservations ['fbdb3ed4-eadb-4043-9ddb-9966cca2a4cf', '6a35cf3f-e3b5-4544-ab13-1d50d1879cac', 'f6e0fd78-d84c-4795-96b6-4959a166f42c', '1b8886a2-5bad-4adf-b024-fd51c622fcea'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:32 devstack sudo[110745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:32 devstack sudo[110745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-b8e272f3-e844-47b2-8ebc-e44753d54d3f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-b8e272f3-e844-47b2-8ebc-e44753d54d3f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "cinder-quobyte-b8e272f3-e844-47b2-8ebc-e44753d54d3f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-b8e272f3-e844-47b2-8ebc-e44753d54d3f" acquired by "delete_volume" :: waited 0.013s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[965b9fc8-15f1-45f2-a26d-1737d157655e]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:33 devstack sudo[110745]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.674s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:33 devstack sudo[110772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f Jun 23 04:37:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Deleted volume successfully. Jun 23 04:37:33 devstack sudo[110772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-aa62319b-a431-4e66-aec9-421d20c6c278 tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-d899a387-9deb-4f97-adce-ac09dbea1061-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:33 devstack sudo[110772]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f" returned: 0 in 0.764s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:33 devstack sudo[110778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f Jun 23 04:37:33 devstack sudo[110778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:34 devstack sudo[110778]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b8e272f3-e844-47b2-8ebc-e44753d54d3f" returned: 0 in 0.631s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-quobyte-b8e272f3-e844-47b2-8ebc-e44753d54d3f" released by "delete_volume" :: held 1.434s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Created reservations ['306a334d-003a-4eac-b28a-a1d30a5f0dba', '5a3aedfc-d999-4c11-ac3e-3d976adace1c', '641b523a-3cfa-4a43-a2bc-725f3cdd0ac2', '598b9398-c876-4717-9554-b006f2a60b76'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:34 devstack sudo[110781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:34 devstack sudo[110781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:35 devstack sudo[110781]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.028s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:35 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:35 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Deleted volume successfully. Jun 23 04:37:35 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cfbabdc6-3558-4fa8-9140-630e115a67de tempest-CreateVolumesFromSourceVolumeTest-1800313444 None] Lock "cinder-b8e272f3-e844-47b2-8ebc-e44753d54d3f-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Flow 'volume_create_manager' (f604ab98-5c49-4128-8c1f-39fb34e0a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4d126-00a1-4718-8eca-bf0c81c69125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68a4d126-00a1-4718-8eca-bf0c81c69125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f62faa-3b8a-4ec4-a2be-734944cd1dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34267d5fc1d04e26a361477547050a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:42Z,use_quota=True,user_id='11ac92168d1b435ba5bca90c0ca502a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4774d1b-0832-49e5-9175-680c50166c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4774d1b-0832-49e5-9175-680c50166c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ac3e6c-febd-4258-8cfe-7380775e0e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ac3e6c-febd-4258-8cfe-7380775e0e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14f62faa-3b8a-4ec4-a2be-734944cd1dcc', 'volume_name': 'volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc', 'volume_size': 1, 'image_id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92ba56ce-11b1-407e-b726-5ae170544b28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '057794ed64b96a432ee8a4468b4017ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34267d5fc1d04e26a361477547050a3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '604e26969227f54322e2ee627f6bb0f1dbd34fb710e3e429843d25115cb001d513a126d7bd27c100c8d7cd9541059cad324cf227421e3e8a6c9330d9923d2017', 'id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'created_at': datetime.datetime(2026, 6, 23, 2, 37, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 37, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92ba56ce-11b1-407e-b726-5ae170544b28/file', 'properties': {}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d56ba7b-ab90-49c0-b236-118a49583f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d56ba7b-ab90-49c0-b236-118a49583f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c3cd69-84a3-420f-bd38-f658d68ae274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:41 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Volume 14f62faa-3b8a-4ec4-a2be-734944cd1dcc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc', 'volume_size': 1, 'image_id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92ba56ce-11b1-407e-b726-5ae170544b28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '057794ed64b96a432ee8a4468b4017ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34267d5fc1d04e26a361477547050a3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '604e26969227f54322e2ee627f6bb0f1dbd34fb710e3e429843d25115cb001d513a126d7bd27c100c8d7cd9541059cad324cf227421e3e8a6c9330d9923d2017', 'id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'created_at': datetime.datetime(2026, 6, 23, 2, 37, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 37, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92ba56ce-11b1-407e-b726-5ae170544b28/file', 'properties': {}}, 'image_service': } Jun 23 04:37:41 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Trying to clone 14f62faa-3b8a-4ec4-a2be-734944cd1dcc from image 92ba56ce-11b1-407e-b726-5ae170544b28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/92ba56ce-11b1-407e-b726-5ae170544b28', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:37:42 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:37:42 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Image download 0.00 MB at 0.00 MB/s Jun 23 04:37:42 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[521c600c-6796-4594-94ca-2f599439acc6]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:42 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD Jun 23 04:37:42 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:42 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:42 devstack sudo[110989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD Jun 23 04:37:42 devstack sudo[110989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:43 devstack sudo[110989]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD" returned: 1 in 0.749s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:37:43 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Temporary image 92ba56ce-11b1-407e-b726-5ae170544b28 is fetched for user 11ac92168d1b435ba5bca90c0ca502a4. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:37:43 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fc83b4-4fc9-4f6b-9b48-67b8ec62cfdc]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:43 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:43 devstack sudo[110994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD Jun 23 04:37:43 devstack sudo[110994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:44 devstack sudo[110994]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:44 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD Jun 23 04:37:44 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:45 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD" returned: 1 in 0.745s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14f62faa-3b8a-4ec4-a2be-734944cd1dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34267d5fc1d04e26a361477547050a3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:37:42Z,use_quota=True,user_id='11ac92168d1b435ba5bca90c0ca502a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Creating volume 14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:37:45 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:37:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:45 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc 1073741824 Jun 23 04:37:45 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:46 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc 1073741824" returned: 0 in 0.803s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:46 devstack sudo[111008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:46 devstack sudo[111008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:46 devstack sudo[111008]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 0 in 0.679s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Attempting download of 92ba56ce-11b1-407e-b726-5ae170544b28 ((None, [{'url': 'file:///opt/stack/data/glance/images/92ba56ce-11b1-407e-b726-5ae170544b28', 'metadata': {}}])) to volume 14f62faa-3b8a-4ec4-a2be-734944cd1dcc. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aab2e04-318f-4a06-8726-5c88a1b36c22]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:46 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe Jun 23 04:37:46 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:47 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe" returned: 0 in 0.724s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:47 devstack sudo[111015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe Jun 23 04:37:47 devstack sudo[111015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:48 devstack sudo[111015]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe" returned: 1 in 0.728s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_92ba56ce-11b1-407e-b726-5ae170544b28__rs90vhe' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:37:48 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b80d535-2df5-4d16-8d85-965e03e36363]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:48 devstack sudo[111019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD Jun 23 04:37:48 devstack sudo[111019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:49 devstack sudo[111019]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:49 devstack sudo[111024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD Jun 23 04:37:49 devstack sudo[111024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:49 devstack sudo[111024]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD" returned: 1 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:37:49 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] 92ba56ce-11b1-407e-b726-5ae170544b28 was raw, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:37:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:49 devstack sudo[111029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:49 devstack sudo[111029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:50 devstack sudo[111029]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 0 in 0.768s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:50 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_92ba56ce-11b1-407e-b726-5ae170544b28_2gn5lpkydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:37:50 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 04:37:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:50 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc 1G Jun 23 04:37:50 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:51 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc 1G" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebc17df-4cba-4e53-987b-17387d0022ae]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:51 devstack sudo[111042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:51 devstack sudo[111042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:51 devstack sudo[111042]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 0 in 0.738s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:52 devstack sudo[111046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:52 devstack sudo[111046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:52 devstack sudo[111046]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 1 in 0.765s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Downloaded image 92ba56ce-11b1-407e-b726-5ae170544b28 ((None, [{'url': 'file:///opt/stack/data/glance/images/92ba56ce-11b1-407e-b726-5ae170544b28', 'metadata': {}}])) to volume 14f62faa-3b8a-4ec4-a2be-734944cd1dcc successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Temporary image 92ba56ce-11b1-407e-b726-5ae170544b28 for user 11ac92168d1b435ba5bca90c0ca502a4 is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Marking volume 14f62faa-3b8a-4ec4-a2be-734944cd1dcc as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Copying metadata from image 92ba56ce-11b1-407e-b726-5ae170544b28 to 14f62faa-3b8a-4ec4-a2be-734944cd1dcc. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Creating volume glance metadata for volume 14f62faa-3b8a-4ec4-a2be-734944cd1dcc backed by image 92ba56ce-11b1-407e-b726-5ae170544b28 with: {'image_id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '057794ed64b96a432ee8a4468b4017ac', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5c3cd69-84a3-420f-bd38-f658d68ae274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc', 'volume_size': 1, 'image_id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/92ba56ce-11b1-407e-b726-5ae170544b28', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '057794ed64b96a432ee8a4468b4017ac', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '34267d5fc1d04e26a361477547050a3c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '604e26969227f54322e2ee627f6bb0f1dbd34fb710e3e429843d25115cb001d513a126d7bd27c100c8d7cd9541059cad324cf227421e3e8a6c9330d9923d2017', 'id': '92ba56ce-11b1-407e-b726-5ae170544b28', 'created_at': datetime.datetime(2026, 6, 23, 2, 37, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 37, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/92ba56ce-11b1-407e-b726-5ae170544b28/file', 'properties': {}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0f9069-14e7-483c-a14d-06a4ec6eb8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:37:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Volume volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc (14f62faa-3b8a-4ec4-a2be-734944cd1dcc): created successfully Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e0f9069-14e7-483c-a14d-06a4ec6eb8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:37:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Flow 'volume_create_manager' (f604ab98-5c49-4128-8c1f-39fb34e0a70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:37:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1aacb4a3-19e9-4546-b0ba-7de92877eac0 tempest-VolumeImageDependencyTests-837437614 None] Created volume successfully. Jun 23 04:37:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Acquiring lock "cinder-14f62faa-3b8a-4ec4-a2be-734944cd1dcc-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Lock "cinder-14f62faa-3b8a-4ec4-a2be-734944cd1dcc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Acquiring lock "cinder-quobyte-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:37:53 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Lock "cinder-quobyte-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" acquired by "delete_volume" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:37:53 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a766f-0374-4aff-9ba9-dba01416932c]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:37:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:53 devstack sudo[111051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:53 devstack sudo[111051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:54 devstack sudo[111051]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 0 in 0.726s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:54 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:54 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:54 devstack sudo[111057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:54 devstack sudo[111057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:54 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 1 in 0.753s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:37:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:54 devstack sudo[111062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc Jun 23 04:37:54 devstack sudo[111062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:55 devstack sudo[111057]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.641s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:37:55 devstack sudo[111062]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" returned: 0 in 0.670s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Lock "cinder-quobyte-14f62faa-3b8a-4ec4-a2be-734944cd1dcc" released by "delete_volume" :: held 2.204s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Created reservations ['e825f42a-1164-4823-bfcf-bf509ba0984b', '2822a21b-f315-4ecf-b1e0-0ef3d30aad1c', '1a19d87f-160e-4c58-aaad-a493632e7360', 'c1b7c0b7-9aa7-4fde-a082-5eda4f76185a'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:37:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:37:55 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:37:55 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:37:56 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Jun 23 04:37:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.616s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:37:56 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:37:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Deleted volume successfully. Jun 23 04:37:56 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-a40223c5-52e4-4a3c-ad47-fbc522f4df87 tempest-VolumeImageDependencyTests-837437614 None] Lock "cinder-14f62faa-3b8a-4ec4-a2be-734944cd1dcc-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:38:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-bfae8b73-3834-4d66-b88c-ba5b8dd62787 req-033e6573-85ea-4696-95d9-2c36ee2fe8f9 tempest-TestMinimumBasicScenario-431768569 None] Terminate volume connection completed successfully. Jun 23 04:38:02 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-bfae8b73-3834-4d66-b88c-ba5b8dd62787 req-033e6573-85ea-4696-95d9-2c36ee2fe8f9 tempest-TestMinimumBasicScenario-431768569 None] Deleting attachment c4bcb69b-ab92-4c80-8955-3dd124da6bd4. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:38:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Acquiring lock "cinder-8e24951d-9093-48a3-91a3-9ee7aceed314-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:38:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Lock "cinder-8e24951d-9093-48a3-91a3-9ee7aceed314-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:38:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Acquiring lock "cinder-quobyte-8e24951d-9093-48a3-91a3-9ee7aceed314" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:38:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Lock "cinder-quobyte-8e24951d-9093-48a3-91a3-9ee7aceed314" acquired by "delete_volume" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:38:04 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0991a08e-ed74-4b67-a9c9-c369fe1de021]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:38:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:38:04 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 Jun 23 04:38:04 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:38:05 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 23 04:38:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314" returned: 0 in 0.777s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:38:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:38:05 devstack sudo[111125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314 Jun 23 04:38:05 devstack sudo[111125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:38:06 devstack sudo[111125]: pam_unix(sudo:session): session closed for user root Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8e24951d-9093-48a3-91a3-9ee7aceed314" returned: 0 in 0.643s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Lock "cinder-quobyte-8e24951d-9093-48a3-91a3-9ee7aceed314" released by "delete_volume" :: held 1.463s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Created reservations ['81f5e60a-0404-49c4-b0e2-9a4735311229', '94277a43-3eed-4821-a89f-e297ea1b90e2', 'fa68cf45-0624-4858-96e4-5d117b2dc93c', '238e51cf-5fac-4687-aa04-b8828f26b196'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:38:06 devstack sudo[111128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:38:06 devstack sudo[111128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:38:06 devstack sudo[111128]: pam_unix(sudo:session): session closed for user root Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.681s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:38:06 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:38:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Deleted volume successfully. Jun 23 04:38:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-df32291f-de80-4fb0-bf96-bd150c42de35 tempest-TestMinimumBasicScenario-431768569 None] Lock "cinder-8e24951d-9093-48a3-91a3-9ee7aceed314-delete_volume" released by "delete_volume" :: held 2.345s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:38:17 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:DELETE=4,cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=38 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:38:25 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=30,cinder:INSERT=16,cinder:UPDATE=35,cinder:DELETE=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:38:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:38:54 devstack sudo[111302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:38:54 devstack sudo[111302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:38:55 devstack sudo[111302]: pam_unix(sudo:session): session closed for user root Jun 23 04:38:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.689s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:38:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:38:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:38:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:38:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Flow 'volume_create_manager' (6f119512-84bf-4108-9ce2-ce49e4687e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e592c886-68b9-4851-8443-9343f45c0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e592c886-68b9-4851-8443-9343f45c0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1991948406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fda5865-a109-4a03-8365-0788b3afed24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e82ca5d6e114ccd99af98b45993e081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:39:18Z,use_quota=True,user_id='3a22da849ccd4fb08e21619f723389fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16941eb-8866-4109-8579-9217c492463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a16941eb-8866-4109-8579-9217c492463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfa5c26-3b8a-4b0b-9486-91285e985547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dfa5c26-3b8a-4b0b-9486-91285e985547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fda5865-a109-4a03-8365-0788b3afed24', 'volume_name': 'volume-3fda5865-a109-4a03-8365-0788b3afed24', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e831156-2ed7-4e15-ace6-1f3f800e9ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e831156-2ed7-4e15-ace6-1f3f800e9ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895407d3-ff3f-4559-8de4-df6c19ec0e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:39:17 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Volume 3fda5865-a109-4a03-8365-0788b3afed24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fda5865-a109-4a03-8365-0788b3afed24', 'volume_size': 1} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:39:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1991948406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fda5865-a109-4a03-8365-0788b3afed24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e82ca5d6e114ccd99af98b45993e081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:39:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:39:18Z,use_quota=True,user_id='3a22da849ccd4fb08e21619f723389fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Creating volume 3fda5865-a109-4a03-8365-0788b3afed24 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:39:17 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:39:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:17 devstack sudo[111363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 1073741824 Jun 23 04:39:17 devstack sudo[111363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:18 devstack sudo[111363]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 1073741824" returned: 0 in 0.827s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:18 devstack sudo[111370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 Jun 23 04:39:18 devstack sudo[111370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:19 devstack sudo[111370]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24" returned: 0 in 0.640s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.512s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895407d3-ff3f-4559-8de4-df6c19ec0e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fda5865-a109-4a03-8365-0788b3afed24', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db05d58f-6f03-447a-962a-5045b2ba8e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:39:19 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Volume volume-3fda5865-a109-4a03-8365-0788b3afed24 (3fda5865-a109-4a03-8365-0788b3afed24): created successfully Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db05d58f-6f03-447a-962a-5045b2ba8e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:39:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Flow 'volume_create_manager' (6f119512-84bf-4108-9ce2-ce49e4687e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:39:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-97fe2c42-6242-4aec-a85d-2562cee4d6a4 tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Created volume successfully. Jun 23 04:39:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:39:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:39:22 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bd9d0c-1366-40aa-bd95-9d16b3097a70]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:39:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:23 devstack sudo[111384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 Jun 23 04:39:23 devstack sudo[111384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:23 devstack sudo[111384]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24" returned: 0 in 0.777s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.792s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:39:23 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-3fda5865-a109-4a03-8365-0788b3afed24', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '13ceb62c-9cd0-4833-9a07-cda329cab91c', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:39:23 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-c658ff55-dd66-4615-b35d-a1f73323fad6 req-eebe0059-41f6-4024-b100-0b3da8ef4b8c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] attachment_update completed successfully. Jun 23 04:39:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-52d574f8-03fe-43f2-aec8-768988dcd67f req-2adeb422-c3f4-42c2-9a6c-72704250654c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Terminate volume connection completed successfully. Jun 23 04:39:30 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-52d574f8-03fe-43f2-aec8-768988dcd67f req-2adeb422-c3f4-42c2-9a6c-72704250654c tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Deleting attachment 13ceb62c-9cd0-4833-9a07-cda329cab91c. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:39:31 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Acquiring lock "cinder-3fda5865-a109-4a03-8365-0788b3afed24-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "cinder-3fda5865-a109-4a03-8365-0788b3afed24-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Acquiring lock "cinder-quobyte-3fda5865-a109-4a03-8365-0788b3afed24" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "cinder-quobyte-3fda5865-a109-4a03-8365-0788b3afed24" acquired by "delete_volume" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4bf8e8-9674-4c83-b3a0-cde2bf45f779]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:32 devstack sudo[111808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 Jun 23 04:39:32 devstack sudo[111808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:32 devstack sudo[111808]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24" returned: 0 in 0.747s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:32 devstack sudo[111813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24 Jun 23 04:39:32 devstack sudo[111813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:33 devstack sudo[111813]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3fda5865-a109-4a03-8365-0788b3afed24" returned: 0 in 0.651s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "cinder-quobyte-3fda5865-a109-4a03-8365-0788b3afed24" released by "delete_volume" :: held 1.437s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Created reservations ['8de2ff8e-0d6d-45cb-a342-c5af2dd0fbe1', '48d0ee6c-eeb6-451b-884f-7acba1562e57', 'eae7b85a-65af-4dc6-817d-42fa83cc412a', '511dd329-2655-4599-b72e-fcbe18506d50'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:39:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:33 devstack sudo[111816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:39:33 devstack sudo[111816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:34 devstack sudo[111816]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.650s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:34 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:39:34 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Deleted volume successfully. Jun 23 04:39:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1c705078-cbe5-4164-8557-5f97667fc7cd tempest-TestServerVolumeAttachScenarioOldVersion-399820935 None] Lock "cinder-3fda5865-a109-4a03-8365-0788b3afed24-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:39:43 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=12,cinder:SELECT=13,cinder:INSERT=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:39:44 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=14,cinder:UPDATE=13,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:39:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:39:54 devstack sudo[111881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:39:54 devstack sudo[111881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:39:55 devstack sudo[111881]: pam_unix(sudo:session): session closed for user root Jun 23 04:39:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.699s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:39:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:39:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:39:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:39:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Flow 'volume_create_manager' (f9902ae1-f12a-4b08-a377-3eb38edf3576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d606f6a-2aed-43ab-ba40-1b49fd32613c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d606f6a-2aed-43ab-ba40-1b49fd32613c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-382638150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9eb5b61-9a18-410a-877c-b1ef1d67d3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaebc134496f40a5936254dc9a4fb595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:40:16Z,use_quota=True,user_id='c2b0bb08901d4e1fa30ff7b04380f104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2161ae4-7927-4905-91cb-0f25c38c9971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2161ae4-7927-4905-91cb-0f25c38c9971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a76f05-fd4e-4239-8e3c-8e991b6b2564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2a76f05-fd4e-4239-8e3c-8e991b6b2564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f9eb5b61-9a18-410a-877c-b1ef1d67d3bc', 'volume_name': 'volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc8ea93-6873-48d0-9036-38336b4f02dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc8ea93-6873-48d0-9036-38336b4f02dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1843e6fc-e849-4f03-9b0b-e839a99b25d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:40:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Volume f9eb5b61-9a18-410a-877c-b1ef1d67d3bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Trying to clone f9eb5b61-9a18-410a-877c-b1ef1d67d3bc from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 at location (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:40:16 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:40:16 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Image download 20.69 MB at 20.69 MB/s Jun 23 04:40:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1a3cf7-d456-4693-b801-c64faacc0008]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:40:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:17 devstack sudo[111925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD Jun 23 04:40:17 devstack sudo[111925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:17 devstack sudo[111925]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD" returned: 0 in 0.710s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:17 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 is fetched for user c2b0bb08901d4e1fa30ff7b04380f104. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:40:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f644345f-2b35-47bb-b90d-07371a1798a8]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:40:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:17 devstack sudo[111930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD Jun 23 04:40:17 devstack sudo[111930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:18 devstack sudo[111930]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-382638150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9eb5b61-9a18-410a-877c-b1ef1d67d3bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaebc134496f40a5936254dc9a4fb595',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:40:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:40:16Z,use_quota=True,user_id='c2b0bb08901d4e1fa30ff7b04380f104',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Creating volume f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:40:18 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:40:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:18 devstack sudo[111935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc 1073741824 Jun 23 04:40:18 devstack sudo[111935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:19 devstack sudo[111935]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc 1073741824" returned: 0 in 0.783s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:19 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:40:19 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:19 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 0.619s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:40:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:40:19 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Attempting download of 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume f9eb5b61-9a18-410a-877c-b1ef1d67d3bc. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:40:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a60396-3974-4907-b024-3d47a797aefd]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:40:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:20 devstack sudo[111944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n Jun 23 04:40:20 devstack sudo[111944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:20 devstack sudo[111944]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n" returned: 0 in 0.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:20 devstack sudo[111948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n Jun 23 04:40:20 devstack sudo[111948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:21 devstack sudo[111948]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n" returned: 1 in 0.725s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_930bd165-a705-4fa7-8ad1-0668e12d9b30_otub5u7n' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:40:21 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4332f1f7-9d27-44db-befd-98248f31fe8f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:40:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:21 devstack sudo[111952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD Jun 23 04:40:21 devstack sudo[111952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:22 devstack sudo[111952]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:22 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] 930bd165-a705-4fa7-8ad1-0668e12d9b30 was qcow2, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:40:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:22 devstack sudo[111957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:40:22 devstack sudo[111957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:23 devstack sudo[111957]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 1.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:23 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_930bd165-a705-4fa7-8ad1-0668e12d9b30_ryj7hyfzdevstack@QuobyteHD, size 112.00 MB, duration 1.78 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:40:23 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Converted 112.00 MB image at 62.84 MB/s Jun 23 04:40:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:24 devstack sudo[111968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc 1G Jun 23 04:40:24 devstack sudo[111968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:24 devstack sudo[111968]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc 1G" returned: 0 in 0.680s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:24 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acddd4-7393-4a10-b24e-8167981515d4]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:40:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:24 devstack sudo[111973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:40:24 devstack sudo[111973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:25 devstack sudo[111973]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 0.733s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:25 devstack sudo[111978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:40:25 devstack sudo[111978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:26 devstack sudo[111978]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 1 in 0.730s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Downloaded image 930bd165-a705-4fa7-8ad1-0668e12d9b30 ((None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}])) to volume f9eb5b61-9a18-410a-877c-b1ef1d67d3bc successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Temporary image 930bd165-a705-4fa7-8ad1-0668e12d9b30 for user c2b0bb08901d4e1fa30ff7b04380f104 is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Marking volume f9eb5b61-9a18-410a-877c-b1ef1d67d3bc as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Copying metadata from image 930bd165-a705-4fa7-8ad1-0668e12d9b30 to f9eb5b61-9a18-410a-877c-b1ef1d67d3bc. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Creating volume glance metadata for volume f9eb5b61-9a18-410a-877c-b1ef1d67d3bc backed by image 930bd165-a705-4fa7-8ad1-0668e12d9b30 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1843e6fc-e849-4f03-9b0b-e839a99b25d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc', 'volume_size': 1, 'image_id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/930bd165-a705-4fa7-8ad1-0668e12d9b30', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '375901c0386949c48b12ecd4e0fb8463', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '930bd165-a705-4fa7-8ad1-0668e12d9b30', 'created_at': datetime.datetime(2026, 6, 23, 2, 13, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 13, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/930bd165-a705-4fa7-8ad1-0668e12d9b30/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173ec750-0da7-4556-a46e-c8f581eca0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:40:26 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Volume volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc (f9eb5b61-9a18-410a-877c-b1ef1d67d3bc): created successfully Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (173ec750-0da7-4556-a46e-c8f581eca0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:40:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Flow 'volume_create_manager' (f9902ae1-f12a-4b08-a377-3eb38edf3576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:40:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-213861fb-240d-468b-8302-065e593d244c tempest-TestShelveInstance-766179906 None] Created volume successfully. Jun 23 04:40:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:40:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:40:34 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2e392d-cb27-4ae2-aea0-ebfc93599e84]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:40:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:34 devstack sudo[111997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:40:34 devstack sudo[111997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:34 devstack sudo[111997]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:35 devstack sudo[112002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:40:35 devstack sudo[112002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:35 devstack sudo[112002]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 1 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:40:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.577s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:40:35 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5619bfc8-02f7-451f-9812-21ab69795755', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:40:35 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-d326709e-1af9-42cc-8f5c-ea774d6c083e req-24c9d37b-12fc-41af-bcf8-9851ecdf5a26 tempest-TestShelveInstance-766179906 None] attachment_update completed successfully. Jun 23 04:40:45 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=19,cinder:UPDATE=6,cinder:INSERT=4 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:40:45 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=7,cinder:SELECT=12,cinder:INSERT=10,cinder:DELETE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:40:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:40:54 devstack sudo[112483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:40:54 devstack sudo[112483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:40:55 devstack sudo[112483]: pam_unix(sudo:session): session closed for user root Jun 23 04:40:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.655s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:40:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:40:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:40:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:40:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:41:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-d977b1b3-da0f-42a6-8267-d339a2b8811f req-34281afd-96e5-4865-aee4-f54d8edf4c77 tempest-TestShelveInstance-766179906 None] Terminate volume connection completed successfully. Jun 23 04:41:13 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-d977b1b3-da0f-42a6-8267-d339a2b8811f req-34281afd-96e5-4865-aee4-f54d8edf4c77 tempest-TestShelveInstance-766179906 None] Deleting attachment 5619bfc8-02f7-451f-9812-21ab69795755. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:41:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:41:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:41:17 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d41b49d-d2a0-4944-94b7-22f177510cc4]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:41:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:41:17 devstack sudo[112685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:41:17 devstack sudo[112685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:41:18 devstack sudo[112685]: pam_unix(sudo:session): session closed for user root Jun 23 04:41:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 0.726s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:41:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:41:18 devstack sudo[112689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:41:18 devstack sudo[112689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:41:19 devstack sudo[112689]: pam_unix(sudo:session): session closed for user root Jun 23 04:41:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 1 in 0.737s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:41:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:41:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.508s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:41:19 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77', 'name': 'volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0487d095-36ce-4a04-86f3-6e898eb3aa28', 'enforce_multipath': True} {{(pid=93326) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 23 04:41:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-1a578353-9391-408c-a5d3-85293abd5ce8 req-2aaa7a84-bc59-405a-aa4a-4af95c33cd07 tempest-TestShelveInstance-766179906 None] attachment_update completed successfully. Jun 23 04:41:29 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=5 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:41:29 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:41:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:41:54 devstack sudo[113216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:41:54 devstack sudo[113216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:41:55 devstack sudo[113216]: pam_unix(sudo:session): session closed for user root Jun 23 04:41:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.659s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:41:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:41:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:41:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:41:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:41:59 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-8882e4d8-330f-4da9-b9a6-6a6f4c78ac6a tempest-TestShelveInstance-766179906 None] Terminate volume connection completed successfully. Jun 23 04:41:59 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-8882e4d8-330f-4da9-b9a6-6a6f4c78ac6a tempest-TestShelveInstance-766179906 None] Deleting attachment 0487d095-36ce-4a04-86f3-6e898eb3aa28. {{(pid=93326) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 23 04:42:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Acquiring lock "cinder-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Lock "cinder-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:42:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Acquiring lock "cinder-quobyte-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Lock "cinder-quobyte-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:42:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[480dba70-aa16-4b62-a248-8726ac7759dc]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:00 devstack sudo[113268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:42:00 devstack sudo[113268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:01 devstack sudo[113268]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:01 devstack sudo[113272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:42:01 devstack sudo[113272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:01 devstack sudo[113272]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 1 in 0.728s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:01 devstack sudo[113277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc Jun 23 04:42:01 devstack sudo[113277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:02 devstack sudo[113277]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" returned: 0 in 0.640s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Lock "cinder-quobyte-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc" released by "delete_volume" :: held 2.172s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG cinder.quota [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Created reservations ['b972a9f8-b40d-482d-9c9a-fc7047be8d6c', '9931fff0-f7da-4774-b510-ecac5c22f20f', '03e5b0bd-8267-4f98-8979-64d40f941a02', '7ff84473-7419-4449-add7-63bd139741c8'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:02 devstack sudo[113280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:42:02 devstack sudo[113280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:03 devstack sudo[113280]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.676s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:03 devstack cinder-volume[93326]: DEBUG cinder.manager [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:42:03 devstack cinder-volume[93326]: INFO cinder.volume.manager [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Deleted volume successfully. Jun 23 04:42:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [req-bbfb8de3-62fb-42b4-b9af-e7fc3bcfcb12 req-cb926a5a-7acc-45e3-951c-6650e5ca0913 tempest-TestShelveInstance-766179906 None] Lock "cinder-f9eb5b61-9a18-410a-877c-b1ef1d67d3bc-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:42:12 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9,cinder:INSERT=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:42:13 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Flow 'volume_create_manager' (2d1bd0b4-8b18-46fa-986d-90c4ac89feec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbe7e17-903a-4001-88b0-73ba1e1a1167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cbe7e17-903a-4001-88b0-73ba1e1a1167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ede695-3a55-4cff-8111-16c379c12563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9714cb66ce8c4f0e8c67e9fe5dcc5676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:16Z,use_quota=True,user_id='efc83c41ba394957b26cd3e818c895be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678403ef-c0a5-498f-b737-930ca09ec125),volume_type_id=678403ef-c0a5-498f-b737-930ca09ec125)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62edf931-6a55-45bc-bb5c-ae052c02f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62edf931-6a55-45bc-bb5c-ae052c02f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d89932-2013-41b2-8ad5-9921a5de96ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d89932-2013-41b2-8ad5-9921a5de96ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45ede695-3a55-4cff-8111-16c379c12563', 'volume_name': 'volume-45ede695-3a55-4cff-8111-16c379c12563', 'volume_size': 1, 'image_id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af1d5114-2c5c-4cdb-a593-3796ce25889d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '073f2645317d1386f91301cd8097686f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9714cb66ce8c4f0e8c67e9fe5dcc5676', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '251518648e0500941d376dade8ef73a8d318924d0b49a17e3016df600fef9c54ebc1d53a92ba9d21cfe0eafe3af6c07546232d7866486b3e6b82750590273e20', 'id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'created_at': datetime.datetime(2026, 6, 23, 2, 42, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af1d5114-2c5c-4cdb-a593-3796ce25889d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fee2e21-9557-46fd-8e11-6d32b5d86075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fee2e21-9557-46fd-8e11-6d32b5d86075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8f9f2d-e172-4aa0-9ec6-8fa0cc7f3221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Volume 45ede695-3a55-4cff-8111-16c379c12563: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45ede695-3a55-4cff-8111-16c379c12563', 'volume_size': 1, 'image_id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af1d5114-2c5c-4cdb-a593-3796ce25889d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '073f2645317d1386f91301cd8097686f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9714cb66ce8c4f0e8c67e9fe5dcc5676', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '251518648e0500941d376dade8ef73a8d318924d0b49a17e3016df600fef9c54ebc1d53a92ba9d21cfe0eafe3af6c07546232d7866486b3e6b82750590273e20', 'id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'created_at': datetime.datetime(2026, 6, 23, 2, 42, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af1d5114-2c5c-4cdb-a593-3796ce25889d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Trying to clone 45ede695-3a55-4cff-8111-16c379c12563 from image af1d5114-2c5c-4cdb-a593-3796ce25889d at location (None, [{'url': 'file:///opt/stack/data/glance/images/af1d5114-2c5c-4cdb-a593-3796ce25889d', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:42:16 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Image download 0.00 MB at 0.00 MB/s Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dde304-c6d9-4a64-b660-f1b10b52ff52]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:16 devstack sudo[113326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD Jun 23 04:42:16 devstack sudo[113326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:17 devstack sudo[113326]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:17 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD Jun 23 04:42:17 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:17 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD" returned: 1 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:17 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Temporary image af1d5114-2c5c-4cdb-a593-3796ce25889d is fetched for user efc83c41ba394957b26cd3e818c895be. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:42:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b5be68-c5ee-4855-ae3e-4ceb0cfece8b]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:18 devstack sudo[113335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD Jun 23 04:42:18 devstack sudo[113335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:18 devstack sudo[113335]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:18 devstack sudo[113340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD Jun 23 04:42:18 devstack sudo[113340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:19 devstack sudo[113340]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD" returned: 1 in 0.704s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ede695-3a55-4cff-8111-16c379c12563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9714cb66ce8c4f0e8c67e9fe5dcc5676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:16Z,use_quota=True,user_id='efc83c41ba394957b26cd3e818c895be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678403ef-c0a5-498f-b737-930ca09ec125),volume_type_id=678403ef-c0a5-498f-b737-930ca09ec125)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Creating volume 45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:19 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:19 devstack sudo[113345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 1073741824 Jun 23 04:42:19 devstack sudo[113345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:20 devstack sudo[113345]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 1073741824" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:20 devstack sudo[113350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:20 devstack sudo[113350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:20 devstack sudo[113350]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 0 in 0.624s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.453s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Attempting download of af1d5114-2c5c-4cdb-a593-3796ce25889d ((None, [{'url': 'file:///opt/stack/data/glance/images/af1d5114-2c5c-4cdb-a593-3796ce25889d', 'metadata': {}}])) to volume 45ede695-3a55-4cff-8111-16c379c12563. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff48eb3d-3919-4cf0-b714-81daa5ac1af4]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:21 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd Jun 23 04:42:21 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:21 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd" returned: 0 in 0.708s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:21 devstack sudo[113357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd Jun 23 04:42:21 devstack sudo[113357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:22 devstack sudo[113357]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd" returned: 1 in 0.717s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_af1d5114-2c5c-4cdb-a593-3796ce25889d_fne_w5dd' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:22 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8124f2e5-4470-426e-a4ea-ca32f2b944e9]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:22 devstack sudo[113361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD Jun 23 04:42:22 devstack sudo[113361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:23 devstack sudo[113361]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD" returned: 0 in 0.717s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:23 devstack sudo[113365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD Jun 23 04:42:23 devstack sudo[113365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:23 devstack sudo[113365]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD" returned: 1 in 0.701s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:23 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] af1d5114-2c5c-4cdb-a593-3796ce25889d was raw, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:42:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:23 devstack sudo[113370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:23 devstack sudo[113370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:24 devstack sudo[113370]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 0 in 0.708s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:24 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_af1d5114-2c5c-4cdb-a593-3796ce25889d_5_jvcatjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:42:24 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 04:42:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:24 devstack sudo[113375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 1G Jun 23 04:42:24 devstack sudo[113375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:25 devstack sudo[113375]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 1G" returned: 0 in 0.653s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:25 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa1458b-08ce-4e1a-bece-557ca2731687]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:25 devstack sudo[113381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:25 devstack sudo[113381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:25 devstack sudo[113381]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 0 in 0.732s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:26 devstack sudo[113385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:26 devstack sudo[113385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:26 devstack sudo[113385]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 1 in 0.725s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Downloaded image af1d5114-2c5c-4cdb-a593-3796ce25889d ((None, [{'url': 'file:///opt/stack/data/glance/images/af1d5114-2c5c-4cdb-a593-3796ce25889d', 'metadata': {}}])) to volume 45ede695-3a55-4cff-8111-16c379c12563 successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Temporary image af1d5114-2c5c-4cdb-a593-3796ce25889d for user efc83c41ba394957b26cd3e818c895be is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Marking volume 45ede695-3a55-4cff-8111-16c379c12563 as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Copying metadata from image af1d5114-2c5c-4cdb-a593-3796ce25889d to 45ede695-3a55-4cff-8111-16c379c12563. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Creating volume glance metadata for volume 45ede695-3a55-4cff-8111-16c379c12563 backed by image af1d5114-2c5c-4cdb-a593-3796ce25889d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '073f2645317d1386f91301cd8097686f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e8f9f2d-e172-4aa0-9ec6-8fa0cc7f3221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ede695-3a55-4cff-8111-16c379c12563', 'volume_size': 1, 'image_id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/af1d5114-2c5c-4cdb-a593-3796ce25889d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '073f2645317d1386f91301cd8097686f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9714cb66ce8c4f0e8c67e9fe5dcc5676', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '251518648e0500941d376dade8ef73a8d318924d0b49a17e3016df600fef9c54ebc1d53a92ba9d21cfe0eafe3af6c07546232d7866486b3e6b82750590273e20', 'id': 'af1d5114-2c5c-4cdb-a593-3796ce25889d', 'created_at': datetime.datetime(2026, 6, 23, 2, 42, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 42, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/af1d5114-2c5c-4cdb-a593-3796ce25889d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c22ebd9-2259-4bfe-982a-53a74a4d87ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:26 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Volume volume-45ede695-3a55-4cff-8111-16c379c12563 (45ede695-3a55-4cff-8111-16c379c12563): created successfully Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c22ebd9-2259-4bfe-982a-53a74a4d87ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Flow 'volume_create_manager' (2d1bd0b4-8b18-46fa-986d-90c4ac89feec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-40af9824-f1c9-460a-a3d0-3b3df06f3072 tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Created volume successfully. Jun 23 04:42:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Acquiring lock "cinder-45ede695-3a55-4cff-8111-16c379c12563-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "cinder-45ede695-3a55-4cff-8111-16c379c12563-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:42:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Acquiring lock "cinder-quobyte-45ede695-3a55-4cff-8111-16c379c12563" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:27 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "cinder-quobyte-45ede695-3a55-4cff-8111-16c379c12563" acquired by "delete_volume" :: waited 0.016s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:42:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[08db847d-bfaa-4b4a-9cbb-9fc2f44e15b7]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:28 devstack sudo[113392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:28 devstack sudo[113392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:28 devstack sudo[113392]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 0 in 0.735s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:28 devstack sudo[113396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:28 devstack sudo[113396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:29 devstack sudo[113396]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 1 in 0.733s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:29 devstack sudo[113402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563 Jun 23 04:42:29 devstack sudo[113402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:29 devstack sudo[113402]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-45ede695-3a55-4cff-8111-16c379c12563" returned: 0 in 0.630s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "cinder-quobyte-45ede695-3a55-4cff-8111-16c379c12563" released by "delete_volume" :: held 2.155s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:42:30 devstack cinder-volume[93326]: WARNING cinder.quota [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:42:30 devstack cinder-volume[93326]: WARNING cinder.quota [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Created reservations ['711e828f-07ed-4e4a-99a4-34a14fb8ce03', 'a91a8951-19b9-42db-ba4b-71a741bcfb46', '254153f1-3c3c-41a0-b46b-ac3af0960ba3', '47eecf8a-00d5-4583-b85f-83dc90abc7da'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:30 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:42:30 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:30 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.640s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:42:30 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Deleted volume successfully. Jun 23 04:42:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-0747c0ce-8be6-4e62-9167-6355be7bba1c tempest-VolumeAndVolumeTypeFromImageTest-1656727810 None] Lock "cinder-45ede695-3a55-4cff-8111-16c379c12563-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:42:40 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=14,cinder:UPDATE=16,cinder:INSERT=12,cinder:DELETE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:42:40 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Flow 'volume_create_manager' (317d5edf-7e71-4951-8065-46c875bf1d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45066c41-84bd-4fc1-8234-d28502f0c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (16221551-4560-4996-b318-0682f78592fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1691e5-8277-4913-a05b-b19703a4b563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45066c41-84bd-4fc1-8234-d28502f0c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca623052-3ef4-4785-a562-2a6505801782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760aff867ea4d56b8046d195147d0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:45Z,use_quota=True,user_id='039b365b33234291bcd481b626d1c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c826f3c-c2bf-4204-89d5-775083fa3569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c826f3c-c2bf-4204-89d5-775083fa3569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df986c96-a7c0-463a-a8c6-3677aa80154f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df986c96-a7c0-463a-a8c6-3677aa80154f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca623052-3ef4-4785-a562-2a6505801782', 'volume_name': 'volume-ca623052-3ef4-4785-a562-2a6505801782', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8704ff-0100-4f3a-83b0-ce152b94f3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da8704ff-0100-4f3a-83b0-ce152b94f3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc236be9-2d3b-488e-9e9f-306033c73182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Volume ca623052-3ef4-4785-a562-2a6505801782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca623052-3ef4-4785-a562-2a6505801782', 'volume_size': 1} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca623052-3ef4-4785-a562-2a6505801782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760aff867ea4d56b8046d195147d0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:45Z,use_quota=True,user_id='039b365b33234291bcd481b626d1c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Creating volume ca623052-3ef4-4785-a562-2a6505801782 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:44 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:44 devstack sudo[113458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 1073741824 Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1691e5-8277-4913-a05b-b19703a4b563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920161001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3754cc1-8bfd-4eed-aec5-9a3e49f55f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:45Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack sudo[113458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e3f129-36af-4ada-8978-a93b4622877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3e3f129-36af-4ada-8978-a93b4622877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e44d19-9097-4477-b0ff-b49dc2d9f53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5e44d19-9097-4477-b0ff-b49dc2d9f53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3754cc1-8bfd-4eed-aec5-9a3e49f55f60', 'volume_name': 'volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d89826d-596e-4da9-b0b3-5c1143d38288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d89826d-596e-4da9-b0b3-5c1143d38288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c014777-8b51-4c7d-b48a-e118fd455e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:44 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume f3754cc1-8bfd-4eed-aec5-9a3e49f55f60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60', 'volume_size': 1} Jun 23 04:42:44 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (2f0c338d-c427-4102-8030-0151fadb156d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5e4219-ec17-465e-8eee-455fdb1842c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5e4219-ec17-465e-8eee-455fdb1842c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-511732444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fbc18c-6d8d-4104-ab21-b56f74e78a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:45Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d510341e-a76b-4284-9008-f1a63fc8d294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d510341e-a76b-4284-9008-f1a63fc8d294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78f8b49-c15a-486a-be5b-de41e27d2a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b78f8b49-c15a-486a-be5b-de41e27d2a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fbc18c-6d8d-4104-ab21-b56f74e78a58', 'volume_name': 'volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef1eda0-8180-4001-897f-0116c3506a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fef1eda0-8180-4001-897f-0116c3506a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20589a1e-3313-4747-ae24-4ffa8cdb2cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Volume e8fbc18c-6d8d-4104-ab21-b56f74e78a58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58', 'volume_size': 1} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (887a74de-61ec-4b07-a9ea-d763d8c49fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773669e9-2b15-49cd-aae9-c8208a8d514b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773669e9-2b15-49cd-aae9-c8208a8d514b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-941272579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cde1eaa-709d-4075-854b-6b392719c5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:46Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f26a4-4319-4005-af18-8ac36b4515c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (190f26a4-4319-4005-af18-8ac36b4515c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f61614-8857-477d-b690-fe005e76ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f61614-8857-477d-b690-fe005e76ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cde1eaa-709d-4075-854b-6b392719c5fb', 'volume_name': 'volume-8cde1eaa-709d-4075-854b-6b392719c5fb', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8e665-b91c-4587-8d70-cb4251fef2e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78d8e665-b91c-4587-8d70-cb4251fef2e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2455dfd-7698-4aba-8c18-c9c9403722fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:45 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Volume 8cde1eaa-709d-4075-854b-6b392719c5fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cde1eaa-709d-4075-854b-6b392719c5fb', 'volume_size': 1} Jun 23 04:42:45 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (110943d2-925a-48d0-8728-117753656606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:46 devstack sudo[113458]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d2d53b-f8e7-4456-890b-4647f873acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 1073741824" returned: 0 in 1.152s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61d2d53b-f8e7-4456-890b-4647f873acba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125415869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95d1157-9d2e-4c4a-ac51-b4bfff709fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:46Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13db3eb-6215-48b0-a23e-bbc9122726c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f13db3eb-6215-48b0-a23e-bbc9122726c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6752667e-201d-424b-9a8c-22653b855a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6752667e-201d-424b-9a8c-22653b855a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a95d1157-9d2e-4c4a-ac51-b4bfff709fbd', 'volume_name': 'volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e518366-6dee-47fc-a82a-ca2613a806a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e518366-6dee-47fc-a82a-ca2613a806a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567be501-c0e8-4c5b-9535-b946c166401b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Volume a95d1157-9d2e-4c4a-ac51-b4bfff709fbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd', 'volume_size': 1} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:46 devstack sudo[113464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 Jun 23 04:42:46 devstack sudo[113464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (30a8bda7-d041-4273-a3e9-9d06f002f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5d74b8-d3bf-41f2-ac76-abd12340a6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea5d74b8-d3bf-41f2-ac76-abd12340a6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-411778242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ce3fb0-5eb3-48d0-80ae-16e5e463998d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:46Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1ba546-9b63-4d29-984f-a9b278888f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea1ba546-9b63-4d29-984f-a9b278888f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bd44e8-94ea-4760-a144-34dde83a5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bd44e8-94ea-4760-a144-34dde83a5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20ce3fb0-5eb3-48d0-80ae-16e5e463998d', 'volume_name': 'volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac10669b-bf27-47fb-b38c-ea4898ff7350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac10669b-bf27-47fb-b38c-ea4898ff7350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d07bd7-8f58-49ff-8f71-10b091fdd81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Volume 20ce3fb0-5eb3-48d0-80ae-16e5e463998d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d', 'volume_size': 1} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (b6eb0e35-32d9-4e34-ab4c-582f3b244476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96661bfc-6af7-49b0-971f-7afd8bc5b670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96661bfc-6af7-49b0-971f-7afd8bc5b670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927152857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763f292c-f4c6-49c8-ac20-125d933b8641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:47Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a58479f-0502-4a8f-905b-c95bb03ed7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a58479f-0502-4a8f-905b-c95bb03ed7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd901ec-e00d-4369-a3ce-effd8f071c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd901ec-e00d-4369-a3ce-effd8f071c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '763f292c-f4c6-49c8-ac20-125d933b8641', 'volume_name': 'volume-763f292c-f4c6-49c8-ac20-125d933b8641', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb347be-a1c0-482e-bcaf-0ae4d6e063e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eb347be-a1c0-482e-bcaf-0ae4d6e063e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817617b-766e-4f31-a047-f16e3a0efaef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:46 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Volume 763f292c-f4c6-49c8-ac20-125d933b8641: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-763f292c-f4c6-49c8-ac20-125d933b8641', 'volume_size': 1} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:46 devstack sudo[113464]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782" returned: 0 in 0.819s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.076s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.977s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920161001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3754cc1-8bfd-4eed-aec5-9a3e49f55f60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:45Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Creating volume f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:46 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:46 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc236be9-2d3b-488e-9e9f-306033c73182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca623052-3ef4-4785-a562-2a6505801782', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:47 devstack sudo[113467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 1073741824 Jun 23 04:42:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c754dbe2-6233-4330-a531-dcf04d809f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:47 devstack sudo[113467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:47 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Volume volume-ca623052-3ef4-4785-a562-2a6505801782 (ca623052-3ef4-4785-a562-2a6505801782): created successfully Jun 23 04:42:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c754dbe2-6233-4330-a531-dcf04d809f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:47 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Flow 'volume_create_manager' (317d5edf-7e71-4951-8065-46c875bf1d33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:47 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-527918be-3559-4ec8-afc1-3ae471fc81a2 tempest-CinderUnicodeTest-1379251442 None] Created volume successfully. Jun 23 04:42:47 devstack sudo[113467]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 1073741824" returned: 0 in 0.913s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:47 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 Jun 23 04:42:47 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Flow 'volume_create_manager' (89de47b0-d7fd-41d6-b514-10d3fa7e8eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738f2b04-da98-4ddc-923d-f4a08d937ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (738f2b04-da98-4ddc-923d-f4a08d937ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1897177796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90c9a4-a1db-4bea-97ed-dfd004c0b083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760aff867ea4d56b8046d195147d0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:48Z,use_quota=True,user_id='039b365b33234291bcd481b626d1c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa1ec2a-7d77-40b6-8349-997e5bde5072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa1ec2a-7d77-40b6-8349-997e5bde5072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf48d44-7065-458c-95ad-414c122f890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bf48d44-7065-458c-95ad-414c122f890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d90c9a4-a1db-4bea-97ed-dfd004c0b083', 'volume_name': 'volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84034320-e1e4-4ecd-94e9-38769cf9c48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84034320-e1e4-4ecd-94e9-38769cf9c48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896f7b97-daa1-455b-8534-1275a0ec4161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Volume 7d90c9a4-a1db-4bea-97ed-dfd004c0b083: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083', 'volume_size': 1} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Flow 'volume_create_manager' (c1f7a46e-88b1-4a19-983d-57298a6a9b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e569609-dc47-451f-bc26-634f98207df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e569609-dc47-451f-bc26-634f98207df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adac3368-59cc-4bb6-b5b7-a25b7defcb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001b40d2b80747ab80a6c5fbf2e381d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:48Z,use_quota=True,user_id='641f23f7f3834127a74376ee126336fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb29e95-8e29-4d5e-9bb5-cc36a3a9e887),volume_type_id=9bb29e95-8e29-4d5e-9bb5-cc36a3a9e887)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fd58a9-30a3-46bd-9857-7a694c1ef1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9fd58a9-30a3-46bd-9857-7a694c1ef1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5823ab-e024-433d-9a68-afc0ba8438df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60" returned: 0 in 0.699s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.369s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-511732444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fbc18c-6d8d-4104-ab21-b56f74e78a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:45Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Creating volume e8fbc18c-6d8d-4104-ab21-b56f74e78a58 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:48 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c014777-8b51-4c7d-b48a-e118fd455e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack sudo[113476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 1073741824 Jun 23 04:42:48 devstack sudo[113476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb19999d-12ad-4e34-960b-8090e406f253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 (f3754cc1-8bfd-4eed-aec5-9a3e49f55f60): created successfully Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb19999d-12ad-4e34-960b-8090e406f253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (16221551-4560-4996-b318-0682f78592fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:48 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7d1fe3fb-d37d-4ff6-b03a-72c0e293b429 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created volume successfully. Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc5823ab-e024-433d-9a68-afc0ba8438df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adac3368-59cc-4bb6-b5b7-a25b7defcb33', 'volume_name': 'volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33', 'volume_size': 1, 'image_id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f446e68568101507ce201455ab4ac57', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '001b40d2b80747ab80a6c5fbf2e381d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9c6d95b55d8da582615b3b29076da12fe7f114ab184c382a7c67f43f2674f7f1df39421549ebfc3f0a1f85a8b88def618437edfba5fb58103534f3818b2103c', 'id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'created_at': datetime.datetime(2026, 6, 23, 2, 42, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 42, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6edba65-7669-4bda-ae40-42bb91c21685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6edba65-7669-4bda-ae40-42bb91c21685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21acc7cd-9da4-4042-a13b-b04409ce6918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:48 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Volume adac3368-59cc-4bb6-b5b7-a25b7defcb33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33', 'volume_size': 1, 'image_id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f446e68568101507ce201455ab4ac57', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '001b40d2b80747ab80a6c5fbf2e381d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9c6d95b55d8da582615b3b29076da12fe7f114ab184c382a7c67f43f2674f7f1df39421549ebfc3f0a1f85a8b88def618437edfba5fb58103534f3818b2103c', 'id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'created_at': datetime.datetime(2026, 6, 23, 2, 42, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 42, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Trying to clone adac3368-59cc-4bb6-b5b7-a25b7defcb33 from image 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:42:48 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:42:48 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Image download 0.00 MB at 0.00 MB/s Jun 23 04:42:49 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a12853a-ff39-4d81-8b0c-0ff3de5fafe5]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:49 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD Jun 23 04:42:49 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:49 devstack sudo[113476]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 1073741824" returned: 0 in 0.870s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:49 devstack sudo[113485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 Jun 23 04:42:49 devstack sudo[113485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:49 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:49 devstack sudo[113489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD Jun 23 04:42:49 devstack sudo[113489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:50 devstack sudo[113485]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58" returned: 0 in 0.699s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.557s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-941272579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cde1eaa-709d-4075-854b-6b392719c5fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:46Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Creating volume 8cde1eaa-709d-4075-854b-6b392719c5fb {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:50 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20589a1e-3313-4747-ae24-4ffa8cdb2cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f71012b-11da-48fa-bded-a091f80fab33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack sudo[113492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb 1073741824 Jun 23 04:42:50 devstack sudo[113492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:50 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Volume volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 (e8fbc18c-6d8d-4104-ab21-b56f74e78a58): created successfully Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f71012b-11da-48fa-bded-a091f80fab33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (2f0c338d-c427-4102-8030-0151fadb156d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:50 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a0515b23-4e59-4d9d-bd94-dc10028ee4cc tempest-CreateVolumesFromImageTest-1055258555 None] Created volume successfully. Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (7a16529c-8286-4926-9bf7-66a2da1ac584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a42ecb6-22c4-40f6-866d-1bd2529cb815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a42ecb6-22c4-40f6-866d-1bd2529cb815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875503146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b296ee16-194e-4ff7-ab45-c0ae3ca8c13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:50Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95147e88-db43-4b84-bb89-24579c1b8348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95147e88-db43-4b84-bb89-24579c1b8348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2f21a7-a91a-43a6-bc82-366c207f8e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2f21a7-a91a-43a6-bc82-366c207f8e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b296ee16-194e-4ff7-ab45-c0ae3ca8c13d', 'volume_name': 'volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afac3bf-4ae8-42a1-a9b4-6585d1ad3db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7afac3bf-4ae8-42a1-a9b4-6585d1ad3db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4250a4e2-6b40-4bd1-95d9-71fadd57a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume b296ee16-194e-4ff7-ab45-c0ae3ca8c13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d', 'volume_size': 1} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:50 devstack sudo[113489]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD" returned: 1 in 0.830s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Temporary image 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 is fetched for user 641f23f7f3834127a74376ee126336fc. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b027831-7daf-4357-9331-aa388043c5e1]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:50 devstack sudo[113497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD Jun 23 04:42:50 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (a7f50450-60b9-4696-9b93-fed702d77f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7d3f79-2179-4cc7-8573-b3d579ce75e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a7d3f79-2179-4cc7-8573-b3d579ce75e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533708504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585277b7-e4e0-49e8-b90c-d9bf6028f9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:51Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48727f94-eaaf-44e5-a051-3572701e8576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48727f94-eaaf-44e5-a051-3572701e8576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17514bad-eec6-4e22-bcc9-91f83fcf795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:50 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17514bad-eec6-4e22-bcc9-91f83fcf795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585277b7-e4e0-49e8-b90c-d9bf6028f9a6', 'volume_name': 'volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bce91c-31bf-4466-af37-cbf7b45231cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1bce91c-31bf-4466-af37-cbf7b45231cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d656b0c2-5d2a-4f6d-877a-c15d1fb1612b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume 585277b7-e4e0-49e8-b90c-d9bf6028f9a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6', 'volume_size': 1} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:51 devstack sudo[113492]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (6730f0df-00b0-421f-bca4-670d5d316c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1cbc88-8c34-4146-aed2-8dabae40dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb 1073741824" returned: 0 in 1.165s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad1cbc88-8c34-4146-aed2-8dabae40dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1303486294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58057995-36d5-4497-8fb1-7f6f258b5969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:51Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366f2830-0e98-4265-98af-9fe1ebf67f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (366f2830-0e98-4265-98af-9fe1ebf67f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d26250-d404-4c46-9bde-3013aae54112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09d26250-d404-4c46-9bde-3013aae54112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58057995-36d5-4497-8fb1-7f6f258b5969', 'volume_name': 'volume-58057995-36d5-4497-8fb1-7f6f258b5969', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb07f71c-b9e7-40cc-bdf6-8ba92e6ec6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb07f71c-b9e7-40cc-bdf6-8ba92e6ec6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e971058-6703-4d5a-b3fa-947930f59942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume 58057995-36d5-4497-8fb1-7f6f258b5969: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58057995-36d5-4497-8fb1-7f6f258b5969', 'volume_size': 1} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:51 devstack sudo[113505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb Jun 23 04:42:51 devstack sudo[113505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:51 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD" returned: 0 in 0.946s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (f3234c0a-e555-4c3a-bfc8-4b37be8b776a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5353812f-421a-4154-9e79-8bab6e33d8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack sudo[113507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5353812f-421a-4154-9e79-8bab6e33d8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184331145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3d01ed-fc63-43b1-b417-101c57b9f1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:52Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack sudo[113507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c808fb3-065c-481b-b180-1507b6f6f837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c808fb3-065c-481b-b180-1507b6f6f837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa32583-07d3-4f9f-8669-6033a8a4ab89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aa32583-07d3-4f9f-8669-6033a8a4ab89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3d01ed-fc63-43b1-b417-101c57b9f1f7', 'volume_name': 'volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb6738d-1a3b-45f2-83a3-d0b269ebe19e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb6738d-1a3b-45f2-83a3-d0b269ebe19e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30036d1f-c8e3-474c-aaa8-8924baae821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume bf3d01ed-fc63-43b1-b417-101c57b9f1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7', 'volume_size': 1} Jun 23 04:42:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (26cc8386-f896-463d-b481-47d64e96be52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec6b95e-e705-41d3-8315-bd88f1828d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec6b95e-e705-41d3-8315-bd88f1828d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832760128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ffb213-b759-4564-b174-81167e5af69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:52Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4d1a6d-994c-42ef-902b-d251c56f974b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a4d1a6d-994c-42ef-902b-d251c56f974b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0798dcfa-1292-493f-9db4-465b67a614f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0798dcfa-1292-493f-9db4-465b67a614f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76ffb213-b759-4564-b174-81167e5af69d', 'volume_name': 'volume-76ffb213-b759-4564-b174-81167e5af69d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329e4bce-20eb-4367-8c41-0b2bb2e3980e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329e4bce-20eb-4367-8c41-0b2bb2e3980e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76473be0-df6a-4e72-92d1-1f2fabff967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume 76ffb213-b759-4564-b174-81167e5af69d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76ffb213-b759-4564-b174-81167e5af69d', 'volume_size': 1} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:52 devstack sudo[113505]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb" returned: 0 in 0.761s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.193s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1125415869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a95d1157-9d2e-4c4a-ac51-b4bfff709fbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:46Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Creating volume a95d1157-9d2e-4c4a-ac51-b4bfff709fbd {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:52 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2455dfd-7698-4aba-8c18-c9c9403722fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cde1eaa-709d-4075-854b-6b392719c5fb', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:52 devstack sudo[113510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd 1073741824 Jun 23 04:42:52 devstack sudo[113510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a650757-a723-485c-931a-c41eff88e26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Volume volume-8cde1eaa-709d-4075-854b-6b392719c5fb (8cde1eaa-709d-4075-854b-6b392719c5fb): created successfully Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a650757-a723-485c-931a-c41eff88e26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (887a74de-61ec-4b07-a9ea-d763d8c49fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-aceeed99-05a7-479f-b1d4-c47c90d310d5 tempest-CreateVolumesFromImageTest-1055258555 None] Created volume successfully. Jun 23 04:42:52 devstack sudo[113507]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:42:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:53 devstack sudo[113510]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd 1073741824" returned: 0 in 0.822s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:53 devstack sudo[113519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd Jun 23 04:42:53 devstack sudo[113519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:53 devstack sudo[113519]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd" returned: 0 in 0.634s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.339s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-411778242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20ce3fb0-5eb3-48d0-80ae-16e5e463998d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:46Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Creating volume 20ce3fb0-5eb3-48d0-80ae-16e5e463998d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:53 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:53 devstack sudo[113522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d 1073741824 Jun 23 04:42:53 devstack sudo[113522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (567be501-c0e8-4c5b-9535-b946c166401b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214c6b5-2d98-44cc-a2e2-0ce4b75e1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:53 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Volume volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd (a95d1157-9d2e-4c4a-ac51-b4bfff709fbd): created successfully Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c214c6b5-2d98-44cc-a2e2-0ce4b75e1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:53 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (110943d2-925a-48d0-8728-117753656606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:53 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-00009872-1f73-4792-8648-a32e065622fb tempest-CreateVolumesFromImageTest-1055258555 None] Created volume successfully. Jun 23 04:42:54 devstack sudo[113522]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d 1073741824" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:54 devstack sudo[113528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:42:54 devstack sudo[113528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:54 devstack sudo[113530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d Jun 23 04:42:54 devstack sudo[113530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:55 devstack sudo[113528]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.652s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:42:55 devstack sudo[113530]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d" returned: 0 in 0.675s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.430s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-927152857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=763f292c-f4c6-49c8-ac20-125d933b8641,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f11f00c196eb47308abb1222c33bda15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:47Z,use_quota=True,user_id='5047d47d541e41e9af75af56e3d01804',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Creating volume 763f292c-f4c6-49c8-ac20-125d933b8641 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:55 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d07bd7-8f58-49ff-8f71-10b091fdd81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:55 devstack sudo[113534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 1073741824 Jun 23 04:42:55 devstack sudo[113534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd17734-671b-4588-b0ba-9820a6cc47d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:55 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Volume volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d (20ce3fb0-5eb3-48d0-80ae-16e5e463998d): created successfully Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd17734-671b-4588-b0ba-9820a6cc47d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (30a8bda7-d041-4273-a3e9-9d06f002f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:55 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-82ba0482-3402-4526-9205-7e612883e659 tempest-CreateVolumesFromImageTest-1055258555 None] Created volume successfully. Jun 23 04:42:56 devstack sudo[113534]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 1073741824" returned: 0 in 0.811s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:56 devstack sudo[113540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 Jun 23 04:42:56 devstack sudo[113540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:56 devstack sudo[113540]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641" returned: 0 in 0.621s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.273s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1897177796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d90c9a4-a1db-4bea-97ed-dfd004c0b083,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1760aff867ea4d56b8046d195147d0c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:48Z,use_quota=True,user_id='039b365b33234291bcd481b626d1c07b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Creating volume 7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:56 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a817617b-766e-4f31-a047-f16e3a0efaef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-763f292c-f4c6-49c8-ac20-125d933b8641', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:56 devstack sudo[113543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 1073741824 Jun 23 04:42:56 devstack sudo[113543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5d3422-443f-43f6-8df3-00bb0769dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:56 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Volume volume-763f292c-f4c6-49c8-ac20-125d933b8641 (763f292c-f4c6-49c8-ac20-125d933b8641): created successfully Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b5d3422-443f-43f6-8df3-00bb0769dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Flow 'volume_create_manager' (b6eb0e35-32d9-4e34-ab4c-582f3b244476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-43d1613e-1bd9-4f40-9eb4-7b05181abc02 tempest-CreateVolumesFromImageTest-1055258555 None] Created volume successfully. Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-763f292c-f4c6-49c8-ac20-125d933b8641-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:57 devstack sudo[113543]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-763f292c-f4c6-49c8-ac20-125d933b8641-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 1073741824" returned: 0 in 0.843s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-quobyte-763f292c-f4c6-49c8-ac20-125d933b8641" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-763f292c-f4c6-49c8-ac20-125d933b8641" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:42:57 devstack sudo[113548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 Jun 23 04:42:57 devstack sudo[113548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff1918e-c060-41b4-b583-bba5656c9780]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:42:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:57 devstack sudo[113550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 Jun 23 04:42:57 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:58 devstack sudo[113548]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" returned: 0 in 0.666s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.563s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.857s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-875503146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b296ee16-194e-4ff7-ab45-c0ae3ca8c13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:50Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Creating volume b296ee16-194e-4ff7-ab45-c0ae3ca8c13d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:42:58 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896f7b97-daa1-455b-8534-1275a0ec4161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba835dd-0219-4bf0-885d-e42d0d2505a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:42:58 devstack sudo[113554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d 1073741824 Jun 23 04:42:58 devstack sudo[113554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Volume volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 (7d90c9a4-a1db-4bea-97ed-dfd004c0b083): created successfully Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dba835dd-0219-4bf0-885d-e42d0d2505a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Flow 'volume_create_manager' (89de47b0-d7fd-41d6-b514-10d3fa7e8eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:42:58 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-480db37e-ac8c-4148-883e-61eee0f305dd tempest-CinderUnicodeTest-1379251442 None] Created volume successfully. Jun 23 04:42:58 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641" returned: 0 in 0.767s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:58 devstack sudo[113558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641 Jun 23 04:42:58 devstack sudo[113558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:59 devstack sudo[113558]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-763f292c-f4c6-49c8-ac20-125d933b8641" returned: 0 in 0.702s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-763f292c-f4c6-49c8-ac20-125d933b8641" released by "delete_volume" :: held 1.525s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Created reservations ['33af34fb-fe1a-404a-b447-ddbb68971a2a', 'fcb6a117-4fe7-423a-8cf9-57c82600a13b', '636bbb09-3375-42a1-8af6-4062818cfd99', 'd0c707c8-0ed7-41d9-acc2-b717118e4185'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:42:59 devstack sudo[113554]: pam_unix(sudo:session): session closed for user root Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d 1073741824" returned: 0 in 0.965s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:42:59 devstack sudo[113565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:42:59 devstack sudo[113565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:59 devstack sudo[113566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d Jun 23 04:42:59 devstack sudo[113566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-20ce3fb0-5eb3-48d0-80ae-16e5e463998d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:42:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-20ce3fb0-5eb3-48d0-80ae-16e5e463998d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-quobyte-20ce3fb0-5eb3-48d0-80ae-16e5e463998d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-20ce3fb0-5eb3-48d0-80ae-16e5e463998d" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f659bd-7ff5-4218-8f54-1a7b1309f2db]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:00 devstack sudo[113566]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d" returned: 0 in 0.713s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.137s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-533708504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585277b7-e4e0-49e8-b90c-d9bf6028f9a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:51Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Creating volume 585277b7-e4e0-49e8-b90c-d9bf6028f9a6 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:00 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:00 devstack sudo[113565]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.761s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Deleted volume successfully. Jun 23 04:43:00 devstack sudo[113572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 1073741824 Jun 23 04:43:00 devstack sudo[113572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4250a4e2-6b40-4bd1-95d9-71fadd57a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97a866f-ba0b-4f0d-8eca-f998e4e5f16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:00 devstack sudo[113571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d Jun 23 04:43:00 devstack sudo[113571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5cd9baa9-c2aa-40cf-9e76-32f44d7d4dc5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-763f292c-f4c6-49c8-ac20-125d933b8641-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d (b296ee16-194e-4ff7-ab45-c0ae3ca8c13d): created successfully Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f97a866f-ba0b-4f0d-8eca-f998e4e5f16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (7a16529c-8286-4926-9bf7-66a2da1ac584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3631b614-10f2-4bf6-aae0-a3d4827c290a tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created volume successfully. Jun 23 04:43:00 devstack sudo[113571]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d" returned: 0 in 0.803s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:00 devstack sudo[113582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d Jun 23 04:43:00 devstack sudo[113582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:01 devstack sudo[113572]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 1073741824" returned: 0 in 0.912s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:01 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 Jun 23 04:43:01 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:01 devstack sudo[113582]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-20ce3fb0-5eb3-48d0-80ae-16e5e463998d" returned: 0 in 0.676s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-20ce3fb0-5eb3-48d0-80ae-16e5e463998d" released by "delete_volume" :: held 1.536s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Created reservations ['e70bb915-e49a-4d80-995a-eeb74471cb89', 'ef7ea928-20c6-40c2-8666-3690612a8d68', '6731d09c-c7bc-4a1e-a80c-bc47a3318872', 'b264b998-8d31-4411-a469-bfda5336f8a3'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:01 devstack sudo[113588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:01 devstack sudo[113588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:01 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6" returned: 0 in 0.673s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.298s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1303486294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58057995-36d5-4497-8fb1-7f6f258b5969,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:51Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Creating volume 58057995-36d5-4497-8fb1-7f6f258b5969 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:01 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d656b0c2-5d2a-4f6d-877a-c15d1fb1612b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:01 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 1073741824 Jun 23 04:43:01 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d80e7ff-693e-4c70-a4af-0f85940854a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:01 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 (585277b7-e4e0-49e8-b90c-d9bf6028f9a6): created successfully Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d80e7ff-693e-4c70-a4af-0f85940854a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:01 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (a7f50450-60b9-4696-9b93-fed702d77f6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:01 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-936a2b10-6a7e-4143-bb1a-2c064015398c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created volume successfully. Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-quobyte-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20920bb-47f8-4961-a6ef-c13209b1fbb4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:02 devstack sudo[113588]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.677s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Deleted volume successfully. Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6153453b-3fa7-41f1-a523-d4b69860389a tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-20ce3fb0-5eb3-48d0-80ae-16e5e463998d-delete_volume" released by "delete_volume" :: held 2.474s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:02 devstack sudo[113593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd Jun 23 04:43:02 devstack sudo[113593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:02 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 1073741824" returned: 0 in 0.943s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:02 devstack sudo[113599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 Jun 23 04:43:02 devstack sudo[113599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:03 devstack sudo[113593]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd" returned: 0 in 0.791s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:03 devstack sudo[113604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd Jun 23 04:43:03 devstack sudo[113604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:03 devstack sudo[113599]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969" returned: 0 in 0.660s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] <== create_volume: return (1644ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.632s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-184331145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3d01ed-fc63-43b1-b417-101c57b9f1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:52Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Creating volume bf3d01ed-fc63-43b1-b417-101c57b9f1f7 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:03 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e971058-6703-4d5a-b3fa-947930f59942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58057995-36d5-4497-8fb1-7f6f258b5969', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:03 devstack sudo[113607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 1073741824 Jun 23 04:43:03 devstack sudo[113607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353d3ce7-8d6c-4fd2-8d8e-198af0f8abba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:03 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume volume-58057995-36d5-4497-8fb1-7f6f258b5969 (58057995-36d5-4497-8fb1-7f6f258b5969): created successfully Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353d3ce7-8d6c-4fd2-8d8e-198af0f8abba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (6730f0df-00b0-421f-bca4-670d5d316c5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:03 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b0ba9c44-1c7d-4ba0-9794-419f1f14df07 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created volume successfully. Jun 23 04:43:03 devstack sudo[113604]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd" released by "delete_volume" :: held 1.495s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Created reservations ['6bd0dfd4-ce2d-4ed1-adfb-a213e475ee38', '0e834e8e-cefe-4a72-90c1-938f2612ddb3', 'fd8ef0f6-341a-4d62-bc1e-35354e530032', 'e86ec2d7-ebe1-4769-bcf2-684c8ea2e372'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:03 devstack sudo[113610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:03 devstack sudo[113610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:04 devstack sudo[113607]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 1073741824" returned: 0 in 0.865s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:04 devstack sudo[113650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 Jun 23 04:43:04 devstack sudo[113650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-8cde1eaa-709d-4075-854b-6b392719c5fb-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-8cde1eaa-709d-4075-854b-6b392719c5fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-quobyte-8cde1eaa-709d-4075-854b-6b392719c5fb" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-8cde1eaa-709d-4075-854b-6b392719c5fb" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7e8af4-64c3-4245-a8f6-967245dffa64]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:04 devstack sudo[113654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb Jun 23 04:43:04 devstack sudo[113654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:04 devstack sudo[113610]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.852s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Deleted volume successfully. Jun 23 04:43:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-115adc54-4863-45a4-a8f5-e23932668d47 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-a95d1157-9d2e-4c4a-ac51-b4bfff709fbd-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:05 devstack sudo[113650]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7" returned: 0 in 0.730s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1832760128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76ffb213-b759-4564-b174-81167e5af69d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13dbb9808ab54b398861faf2d1b1df31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:52Z,use_quota=True,user_id='67fea152d6f647c7b757ee78a7073d71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Creating volume 76ffb213-b759-4564-b174-81167e5af69d {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:05 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:05 devstack sudo[113658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d 1073741824 Jun 23 04:43:05 devstack sudo[113658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30036d1f-c8e3-474c-aaa8-8924baae821b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99191bc-769b-472c-bfb4-1c64ab1225b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:05 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 (bf3d01ed-fc63-43b1-b417-101c57b9f1f7): created successfully Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99191bc-769b-472c-bfb4-1c64ab1225b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (f3234c0a-e555-4c3a-bfc8-4b37be8b776a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7629bc44-4ec9-472d-8c14-92934839e873 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created volume successfully. Jun 23 04:43:05 devstack sudo[113654]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb" returned: 0 in 0.764s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:05 devstack sudo[113663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb Jun 23 04:43:05 devstack sudo[113663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:05 devstack sudo[113658]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d 1073741824" returned: 0 in 0.846s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:06 devstack sudo[113669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d Jun 23 04:43:06 devstack sudo[113669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:06 devstack sudo[113663]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-8cde1eaa-709d-4075-854b-6b392719c5fb" returned: 0 in 0.693s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-8cde1eaa-709d-4075-854b-6b392719c5fb" released by "delete_volume" :: held 1.525s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Created reservations ['bbfd976f-e546-4935-b73e-37e61c7fbf03', '8a80b620-4711-473d-b4f5-5bc019295302', '5ad86f4e-46e1-473d-ba94-098b434a36ea', 'e15b3ac4-ac8a-4988-adc2-a8f5a9931bcf'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:06 devstack sudo[113671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:06 devstack sudo[113671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:06 devstack sudo[113669]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d" returned: 0 in 0.638s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] <== create_volume: return (1526ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.222s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:42:48Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adac3368-59cc-4bb6-b5b7-a25b7defcb33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001b40d2b80747ab80a6c5fbf2e381d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:42:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:42:48Z,use_quota=True,user_id='641f23f7f3834127a74376ee126336fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9bb29e95-8e29-4d5e-9bb5-cc36a3a9e887),volume_type_id=9bb29e95-8e29-4d5e-9bb5-cc36a3a9e887)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Creating volume adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:06 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:06 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 1073741824 Jun 23 04:43:06 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76473be0-df6a-4e72-92d1-1f2fabff967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76ffb213-b759-4564-b174-81167e5af69d', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280c3a7-82d8-47cf-ad4e-7c17f8e69fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Volume volume-76ffb213-b759-4564-b174-81167e5af69d (76ffb213-b759-4564-b174-81167e5af69d): created successfully Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f280c3a7-82d8-47cf-ad4e-7c17f8e69fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Flow 'volume_create_manager' (26cc8386-f896-463d-b481-47d64e96be52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6f4585f-6189-4add-8bbc-8ecb96989a8c tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created volume successfully. Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-e8fbc18c-6d8d-4104-ab21-b56f74e78a58-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-e8fbc18c-6d8d-4104-ab21-b56f74e78a58-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "cinder-quobyte-e8fbc18c-6d8d-4104-ab21-b56f74e78a58" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-e8fbc18c-6d8d-4104-ab21-b56f74e78a58" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce95ce1-6334-4c92-9b07-ba907ed2c5aa]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:06 devstack sudo[113671]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.746s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:06 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:07 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Deleted volume successfully. Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-14a64c3f-b981-4b84-8644-e918747351b5 tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-8cde1eaa-709d-4075-854b-6b392719c5fb-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:07 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 Jun 23 04:43:07 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-76ffb213-b759-4564-b174-81167e5af69d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-76ffb213-b759-4564-b174-81167e5af69d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-quobyte-76ffb213-b759-4564-b174-81167e5af69d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-76ffb213-b759-4564-b174-81167e5af69d" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b98ab16-63cf-4d15-9294-8e693454d2ed]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:07 devstack sudo[113680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d Jun 23 04:43:07 devstack sudo[113680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:07 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 1073741824" returned: 0 in 0.934s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:07 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:07 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:07 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58" returned: 0 in 0.871s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:07 devstack sudo[113690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58 Jun 23 04:43:07 devstack sudo[113690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:08 devstack sudo[113680]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d" returned: 0 in 0.837s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:08 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d Jun 23 04:43:08 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:08 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 0 in 0.703s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.144s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Creating offline snapshot 31429b35-6f9e-4a34-901b-5d77fc147a17 of volume 7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b1a57e-fc95-4ca9-8fef-eaa9b57be859]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Attempting download of 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'metadata': {}}])) to volume adac3368-59cc-4bb6-b5b7-a25b7defcb33. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63a8b7-edae-4083-9e8a-0bdb41015222]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:08 devstack sudo[113690]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-e8fbc18c-6d8d-4104-ab21-b56f74e78a58" returned: 0 in 0.674s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:08 devstack sudo[113699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 Jun 23 04:43:08 devstack sudo[113699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-quobyte-e8fbc18c-6d8d-4104-ab21-b56f74e78a58" released by "delete_volume" :: held 1.604s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:08 devstack sudo[113700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd Jun 23 04:43:08 devstack sudo[113700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Created reservations ['e47cafae-ad2e-48d7-8a90-321986243c56', 'da0b1dea-7eeb-469a-ab85-d5d778ff5d86', '093a0410-ce24-48d8-a2ff-5328c77c31af', '0eb263cb-4741-4f0d-9924-77869fec9b5f'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:08 devstack sudo[113704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:08 devstack sudo[113704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:08 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-76ffb213-b759-4564-b174-81167e5af69d" returned: 0 in 0.719s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-76ffb213-b759-4564-b174-81167e5af69d" released by "delete_volume" :: held 1.604s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created reservations ['156fe058-021d-4953-9bf8-b42666d7466a', 'ff5003f2-28fb-4dd0-8743-7f2dfca128bc', 'ce2587bb-a5a3-4b27-946c-acf2f0dcac9d', 'fbf2ab2e-3d53-426b-868d-f91e90322a85'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:08 devstack sudo[113707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:08 devstack sudo[113707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:09 devstack sudo[113699]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" returned: 0 in 1.005s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:09 devstack sudo[113714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 1G Jun 23 04:43:09 devstack sudo[113714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-bf3d01ed-fc63-43b1-b417-101c57b9f1f7-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:09 devstack sudo[113700]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-bf3d01ed-fc63-43b1-b417-101c57b9f1f7-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd" returned: 0 in 1.069s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-quobyte-bf3d01ed-fc63-43b1-b417-101c57b9f1f7" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-bf3d01ed-fc63-43b1-b417-101c57b9f1f7" acquired by "delete_volume" :: waited 0.034s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8726086-6138-4190-a0d7-205a83301ec0]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:09 devstack sudo[113716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd Jun 23 04:43:09 devstack sudo[113716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:09 devstack sudo[113704]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.134s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Deleted volume successfully. Jun 23 04:43:09 devstack sudo[113707]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.951s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-93061bca-9192-42a5-9e34-e0a0cca9d79c tempest-CreateVolumesFromImageTest-1055258555 None] Lock "cinder-e8fbc18c-6d8d-4104-ab21-b56f74e78a58-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:09 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Deleted volume successfully. Jun 23 04:43:09 devstack sudo[113719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 Jun 23 04:43:09 devstack sudo[113719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:09 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-75adecab-30e7-4d40-a939-c4eff6821835 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-76ffb213-b759-4564-b174-81167e5af69d-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:10 devstack sudo[113716]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd" returned: 1 in 1.092s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_ta2m92cd' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[f211cfe9-2bb8-4af6-b8e4-a7a1c58151e3]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 1G" returned: 0 in 1.328s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:10 devstack sudo[113714]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:10 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 Jun 23 04:43:10 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:10 devstack sudo[113729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD Jun 23 04:43:10 devstack sudo[113729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:10 devstack sudo[113719]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7" returned: 0 in 1.131s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:10 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7 Jun 23 04:43:10 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:11 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17" returned: 0 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:11 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 is being set with open permissions: ugo+rw Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:11 devstack sudo[113729]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:11 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 Jun 23 04:43:11 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:11 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-bf3d01ed-fc63-43b1-b417-101c57b9f1f7" returned: 0 in 0.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-bf3d01ed-fc63-43b1-b417-101c57b9f1f7" released by "delete_volume" :: held 1.972s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:11 devstack sudo[113744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD Jun 23 04:43:11 devstack sudo[113744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created reservations ['18d8b40a-ed15-48b7-959c-44d695ed9d36', 'c925a3a9-7fb7-4071-9eb9-76c12ab6085e', 'cf57bc9b-ce8c-42ea-aef2-37b85e1a080a', '1a90777b-f6bb-446f-8940-c151eb56c90b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:11 devstack sudo[113747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:11 devstack sudo[113747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-58057995-36d5-4497-8fb1-7f6f258b5969-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:11 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-58057995-36d5-4497-8fb1-7f6f258b5969-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-quobyte-58057995-36d5-4497-8fb1-7f6f258b5969" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-58057995-36d5-4497-8fb1-7f6f258b5969" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ad2c17-3ada-40c4-97f3-ddb377c0e095]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:12 devstack sudo[113749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 Jun 23 04:43:12 devstack sudo[113749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:12 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17" returned: 0 in 0.852s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:12 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info Jun 23 04:43:12 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:12 devstack sudo[113744]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD" returned: 1 in 0.964s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 was raw, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:12 devstack sudo[113757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:12 devstack sudo[113757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:12 devstack sudo[113747]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.969s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:12 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Deleted volume successfully. Jun 23 04:43:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-938268c3-636c-4f7d-8512-534f06440ab5 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-bf3d01ed-fc63-43b1-b417-101c57b9f1f7-delete_volume" released by "delete_volume" :: held 3.325s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:13 devstack sudo[113749]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969" returned: 0 in 1.101s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:13 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969 Jun 23 04:43:13 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:13 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info" returned: 0 in 0.845s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:13 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info is being set with open permissions: ugo+rw Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:13 devstack sudo[113770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info Jun 23 04:43:13 devstack sudo[113770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:13 devstack sudo[113757]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 0 in 0.918s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6d5a8b89-e78a-4c17-ad90-781dd7f609c0_0lz8lkaudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:43:13 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:13 devstack sudo[113772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 1G Jun 23 04:43:13 devstack sudo[113772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:13 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-58057995-36d5-4497-8fb1-7f6f258b5969" returned: 0 in 0.727s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-58057995-36d5-4497-8fb1-7f6f258b5969" released by "delete_volume" :: held 1.888s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created reservations ['2e0f5bc2-669d-4e81-97c4-d2a6f3c0dfbd', 'f9b22483-905d-4996-b392-81ae0bf9b2a7', 'bbe6d1b3-fb57-4b6f-b4aa-40dde0803c9c', 'bc933a54-895c-49df-8e0a-661901520dec'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:14 devstack sudo[113770]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.info" returned: 0 in 0.720s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.701s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5b953a6d-ed68-4c41-b944-d27686616319 tempest-CinderUnicodeTest-1379251442 None] Create snapshot completed successfully Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:14 devstack sudo[113778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:14 devstack sudo[113778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-585277b7-e4e0-49e8-b90c-d9bf6028f9a6-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:14 devstack sudo[113772]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 1G" returned: 0 in 0.878s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-585277b7-e4e0-49e8-b90c-d9bf6028f9a6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0dce2b-4d50-49f7-9e61-6543c860d479]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-quobyte-585277b7-e4e0-49e8-b90c-d9bf6028f9a6" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-585277b7-e4e0-49e8-b90c-d9bf6028f9a6" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ea8db7-2151-4d30-ac9f-eee02fe135f7]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:14 devstack sudo[113781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:14 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:14 devstack sudo[113782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 Jun 23 04:43:14 devstack sudo[113782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:14 devstack sudo[113778]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.782s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:14 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Deleted volume successfully. Jun 23 04:43:14 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-629c6ac1-e7e3-4e1f-8c78-ef4acab2f3be tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-58057995-36d5-4497-8fb1-7f6f258b5969-delete_volume" released by "delete_volume" :: held 3.007s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-31429b35-6f9e-4a34-901b-5d77fc147a17-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-31429b35-6f9e-4a34-901b-5d77fc147a17-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-quobyte-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-quobyte-31429b35-6f9e-4a34-901b-5d77fc147a17" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-31429b35-6f9e-4a34-901b-5d77fc147a17" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Deleting offline snapshot 31429b35-6f9e-4a34-901b-5d77fc147a17 of volume 7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] snapshot_file for this snap is: volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[5800a1e4-003f-4be7-9403-6b2936ad37dd]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:15 devstack sudo[113786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 Jun 23 04:43:15 devstack sudo[113786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:15 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 0 in 0.920s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:15 devstack sudo[113782]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6" returned: 0 in 0.946s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:15 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:15 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:15 devstack sudo[113794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6 Jun 23 04:43:15 devstack sudo[113794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Flow 'volume_create_manager' (9308c95e-69ae-462c-8cf3-a809a8b25819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e27c126-47a2-46a6-a06b-1170df2545d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:16 devstack sudo[113786]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17" returned: 0 in 0.925s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e27c126-47a2-46a6-a06b-1170df2545d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aae40cd-0438-4dbe-8e95-17e75dad3e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58caaea529884110916b9aaec084b20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:16Z,use_quota=True,user_id='aede65168e7a414c8cd6897588fb4840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f5e50d-e409-4796-8c41-c8ad8dfdfc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89f5e50d-e409-4796-8c41-c8ad8dfdfc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97110d27-4b32-473f-a876-e5c046ed47f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.image.glance [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Creating Keystone auth plugin from conf {{(pid=93326) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b09fd-33f5-4790-ab86-b787bb39aa91]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:16 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 1 in 0.859s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Downloaded image 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 ((None, [{'url': 'file:///opt/stack/data/glance/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'metadata': {}}])) to volume adac3368-59cc-4bb6-b5b7-a25b7defcb33 successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Temporary image 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 for user 641f23f7f3834127a74376ee126336fc is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Marking volume adac3368-59cc-4bb6-b5b7-a25b7defcb33 as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Copying metadata from image 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 to adac3368-59cc-4bb6-b5b7-a25b7defcb33. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Creating volume glance metadata for volume adac3368-59cc-4bb6-b5b7-a25b7defcb33 backed by image 6d5a8b89-e78a-4c17-ad90-781dd7f609c0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8f446e68568101507ce201455ab4ac57', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:43:16 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 Jun 23 04:43:16 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:16 devstack sudo[113794]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-585277b7-e4e0-49e8-b90c-d9bf6028f9a6" returned: 0 in 0.829s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-585277b7-e4e0-49e8-b90c-d9bf6028f9a6" released by "delete_volume" :: held 1.831s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21acc7cd-9da4-4042-a13b-b04409ce6918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33', 'volume_size': 1, 'image_id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8f446e68568101507ce201455ab4ac57', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '001b40d2b80747ab80a6c5fbf2e381d6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e9c6d95b55d8da582615b3b29076da12fe7f114ab184c382a7c67f43f2674f7f1df39421549ebfc3f0a1f85a8b88def618437edfba5fb58103534f3818b2103c', 'id': '6d5a8b89-e78a-4c17-ad90-781dd7f609c0', 'created_at': datetime.datetime(2026, 6, 23, 2, 42, 46, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 42, 47, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6d5a8b89-e78a-4c17-ad90-781dd7f609c0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc592a7-5bff-422e-92f3-b682c36909e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Volume volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 (adac3368-59cc-4bb6-b5b7-a25b7defcb33): created successfully Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dc592a7-5bff-422e-92f3-b682c36909e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Flow 'volume_create_manager' (c1f7a46e-88b1-4a19-983d-57298a6a9b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97110d27-4b32-473f-a876-e5c046ed47f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0aae40cd-0438-4dbe-8e95-17e75dad3e63', 'volume_name': 'volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63', 'volume_size': 1, 'image_id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb7dbfa9ea418997cc6d9b2317a58c3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58caaea529884110916b9aaec084b20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '683b9332e7ba7e020a14cd35900951cbf13b477b52d11b4030c1dd7e33f7d7a077a1c7b213470f24ad5f1445237a13f7f77d6371bff190c0c8d74399215fce3e', 'id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'created_at': datetime.datetime(2026, 6, 23, 2, 43, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 43, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8/file', 'properties': {}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b11985-38f6-4dc1-b12a-b5d79368dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01b11985-38f6-4dc1-b12a-b5d79368dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75929500-fc38-49aa-b2e8-e10b5127a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:16 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Volume 0aae40cd-0438-4dbe-8e95-17e75dad3e63: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63', 'volume_size': 1, 'image_id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb7dbfa9ea418997cc6d9b2317a58c3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58caaea529884110916b9aaec084b20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '683b9332e7ba7e020a14cd35900951cbf13b477b52d11b4030c1dd7e33f7d7a077a1c7b213470f24ad5f1445237a13f7f77d6371bff190c0c8d74399215fce3e', 'id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'created_at': datetime.datetime(2026, 6, 23, 2, 43, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 43, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8/file', 'properties': {}}, 'image_service': } Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Trying to clone 0aae40cd-0438-4dbe-8e95-17e75dad3e63 from image f10f43a4-c557-4eee-9a0b-087936c9e2e8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'metadata': {}}]). {{(pid=93326) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created reservations ['1bd820c7-6f18-4e08-984a-ab4948e29919', '3e51cda4-6e37-4723-b0b0-6afeb3910bc1', 'ca0e8909-c17d-43d6-b6de-b708a54f6339', 'cf0a6937-7da6-4f69-9360-e2f70b02ac73'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:16 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5f2ac890-ee42-42a2-861e-92d740a1eee4 tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Created volume successfully. Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 23 04:43:16 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Image download 0.00 MB at 0.00 MB/s Jun 23 04:43:16 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:16 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Acquiring lock "cinder-adac3368-59cc-4bb6-b5b7-a25b7defcb33-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "cinder-adac3368-59cc-4bb6-b5b7-a25b7defcb33-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d8558a-dc8b-411c-8ec5-9446157feadf]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Acquiring lock "cinder-quobyte-adac3368-59cc-4bb6-b5b7-a25b7defcb33" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "cinder-quobyte-adac3368-59cc-4bb6-b5b7-a25b7defcb33" acquired by "delete_volume" :: waited 0.030s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-quobyte-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:16 devstack sudo[113808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD Jun 23 04:43:16 devstack sudo[113808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed9c3d1-123e-45ec-a375-c6b0f9785c67]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[248eb06e-16ae-425c-893c-dc831a6e0320]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:17 devstack sudo[113811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d Jun 23 04:43:17 devstack sudo[113811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:17 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:17 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:17 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" returned: 0 in 1.151s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:17 devstack sudo[113817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 Jun 23 04:43:17 devstack sudo[113817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:17 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.127s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:17 devstack sudo[113808]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:17 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Deleted volume successfully. Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD" returned: 0 in 1.023s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-fbd7f62f-ee87-4dc1-ba81-219af511cc28 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-585277b7-e4e0-49e8-b90c-d9bf6028f9a6-delete_volume" released by "delete_volume" :: held 3.344s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:17 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD Jun 23 04:43:17 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:17 devstack sudo[113811]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d" returned: 0 in 0.996s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:17 devstack sudo[113829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d Jun 23 04:43:17 devstack sudo[113829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:17 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 0 in 1.112s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:18 devstack sudo[113833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:18 devstack sudo[113833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:18 devstack sudo[113817]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17" returned: 0 in 0.928s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:18 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17 Jun 23 04:43:18 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:18 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD" returned: 1 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Temporary image f10f43a4-c557-4eee-9a0b-087936c9e2e8 is fetched for user aede65168e7a414c8cd6897588fb4840. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 23 04:43:18 devstack sudo[113829]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d" returned: 0 in 0.728s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d" released by "delete_volume" :: held 1.795s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a8e337-3c3e-436c-b7e0-d5801aca5103]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created reservations ['7404db3e-3f6d-4b7c-a029-be1ce566023e', '0a2e8d3a-d9b9-4e49-8b89-fa638a69c84a', '7c552f83-c685-463c-aebd-005b20359b6a', '32376fa2-2051-4c0c-b692-61a9ce1a2cb0'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:18 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD Jun 23 04:43:18 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:18 devstack sudo[113833]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 1 in 0.855s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:18 devstack sudo[113849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:18 devstack sudo[113849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:18 devstack sudo[113850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33 Jun 23 04:43:18 devstack sudo[113850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:18 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083.31429b35-6f9e-4a34-901b-5d77fc147a17" returned: 0 in 0.738s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-31429b35-6f9e-4a34-901b-5d77fc147a17" released by "_delete_snapshot" :: held 3.920s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" released by "delete_snapshot" :: held 3.952s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "cinder-quobyte-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Created reservations ['065cc34b-a91c-45fe-9c71-68d425387813', 'f6eae037-f8bb-4faa-b2f5-d0194d379ed1', '35ba95fa-e314-4aab-9075-1d6c64720ea6', 'a0094fd9-56a7-4b18-b4d3-a7c9da7b7795'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60" acquired by "delete_volume" :: waited 0.036s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4c9645-dd2f-4e68-9d74-43d88eba8ce9]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Delete snapshot completed successfully. Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-3f7e1423-a937-476a-8a64-d9581128f5c8 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-31429b35-6f9e-4a34-901b-5d77fc147a17-delete_snapshot" released by "delete_snapshot" :: held 4.341s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:19 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 Jun 23 04:43:19 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:19 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD" returned: 0 in 0.879s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:19 devstack sudo[113849]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.782s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:19 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Deleted volume successfully. Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-e3a28c7b-2ffd-435a-ae88-56bfa71bcd30 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-b296ee16-194e-4ff7-ab45-c0ae3ca8c13d-delete_volume" released by "delete_volume" :: held 2.915s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:19 devstack sudo[113859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD Jun 23 04:43:19 devstack sudo[113850]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:19 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-adac3368-59cc-4bb6-b5b7-a25b7defcb33" returned: 0 in 0.836s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "cinder-quobyte-adac3368-59cc-4bb6-b5b7-a25b7defcb33" released by "delete_volume" :: held 2.964s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Created reservations ['a4d43d7d-6a5f-4173-b7f2-f1ea58148836', 'db395603-10a9-4e05-8752-1af71651386b', '3286ed75-d90c-4dd8-91c3-29cd933619dd', 'fff62ec8-f9a2-4e02-a9c4-57a013420a61'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:19 devstack sudo[113861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:19 devstack sudo[113861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:20 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60" returned: 0 in 0.928s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:20 devstack sudo[113869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60 Jun 23 04:43:20 devstack sudo[113869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-7d90c9a4-a1db-4bea-97ed-dfd004c0b083-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-7d90c9a4-a1db-4bea-97ed-dfd004c0b083-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:20 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD" returned: 1 in 0.983s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aae40cd-0438-4dbe-8e95-17e75dad3e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58caaea529884110916b9aaec084b20e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:16Z,use_quota=True,user_id='aede65168e7a414c8cd6897588fb4840',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Creating volume 0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:20 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-quobyte-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:20 devstack sudo[113872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 1073741824 Jun 23 04:43:20 devstack sudo[113872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" acquired by "delete_volume" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:20 devstack sudo[113861]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.841s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5f6341-9e38-400d-9f14-4a223d0f6801]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:20 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Deleted volume successfully. Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-2c93898e-6afd-44ae-8837-6b0f9642eb1f tempest-VolumeAndVolumeTypeFromImageTest-312026842 None] Lock "cinder-adac3368-59cc-4bb6-b5b7-a25b7defcb33-delete_volume" released by "delete_volume" :: held 4.128s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:20 devstack sudo[113874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 Jun 23 04:43:20 devstack sudo[113874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:20 devstack sudo[113869]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60" returned: 0 in 0.738s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:20 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-quobyte-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60" released by "delete_volume" :: held 1.732s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Created reservations ['886ab52f-4496-460f-bb23-cf0e6a136f78', '9b5066ca-aeb1-4254-824d-c64c46bf0b39', '1f1ed6f3-8866-40b5-8e30-8675179befad', 'a1500cdb-61b3-4524-9b44-76640e662bf6'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:21 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:21 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:21 devstack sudo[113872]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 1073741824" returned: 0 in 1.159s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:21 devstack sudo[113874]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" returned: 0 in 1.068s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:21 devstack sudo[113887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083 Jun 23 04:43:21 devstack sudo[113887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:21 devstack sudo[113888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:21 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:22 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.884s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:22 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Deleted volume successfully. Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9ae64d1-e372-4f70-a5e7-e9932f2aabf4 tempest-CreateVolumesFromSourceVolumeTest-776639299 None] Lock "cinder-f3754cc1-8bfd-4eed-aec5-9a3e49f55f60-delete_volume" released by "delete_volume" :: held 2.944s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 0 in 0.784s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:22 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:22 devstack sudo[113887]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" returned: 0 in 0.858s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Attempting download of f10f43a4-c557-4eee-9a0b-087936c9e2e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'metadata': {}}])) to volume 0aae40cd-0438-4dbe-8e95-17e75dad3e63. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-7d90c9a4-a1db-4bea-97ed-dfd004c0b083" released by "delete_volume" :: held 1.996s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ced8dd-2e7d-4d4d-9374-e785021dbdc6]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Created reservations ['1ceb7bcb-6b31-4cf2-b571-6e4fb656176b', 'c87f8b4a-8ec4-4e4a-ade1-1e6f4fb50c77', '92668397-9bd0-4584-a9c2-cb33c3cdd594', '8560ce31-4fb1-4c68-a0af-90c62abca332'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:22 devstack sudo[113895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:22 devstack sudo[113895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:22 devstack sudo[113894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4 Jun 23 04:43:22 devstack sudo[113894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:23 devstack sudo[113895]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:23 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Deleted volume successfully. Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-98fe70fe-ad8e-4681-93c5-e56383f89849 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-7d90c9a4-a1db-4bea-97ed-dfd004c0b083-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:23 devstack sudo[113894]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4" returned: 0 in 1.022s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:23 devstack sudo[113901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4 Jun 23 04:43:23 devstack sudo[113901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-ca623052-3ef4-4785-a562-2a6505801782-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-ca623052-3ef4-4785-a562-2a6505801782-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "cinder-quobyte-ca623052-3ef4-4785-a562-2a6505801782" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-ca623052-3ef4-4785-a562-2a6505801782" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[46af3a7c-d140-46c5-9adc-f051808f3df6]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:24 devstack sudo[113903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 Jun 23 04:43:24 devstack sudo[113903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:24 devstack sudo[113901]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4" returned: 1 in 0.891s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f10f43a4-c557-4eee-9a0b-087936c9e2e8_kljmhqi4' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc02e9-e25f-42bf-9f24-7ab3b94692f5]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:24 devstack sudo[113907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD Jun 23 04:43:24 devstack sudo[113907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:25 devstack sudo[113903]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782" returned: 0 in 0.990s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:25 devstack sudo[113913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782 Jun 23 04:43:25 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:25 devstack sudo[113907]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD" returned: 0 in 0.887s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:25 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD Jun 23 04:43:25 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:25 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-ca623052-3ef4-4785-a562-2a6505801782" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-quobyte-ca623052-3ef4-4785-a562-2a6505801782" released by "delete_volume" :: held 1.834s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Flow 'volume_create_manager' (12d494f0-2380-4bf5-ab72-643b58ef28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb8cb67-d8d1-47b0-ae41-2f68d18c3626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9eb8cb67-d8d1-47b0-ae41-2f68d18c3626) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-353227206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8261ee048f94384bad29412f715f4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:26Z,use_quota=True,user_id='b18cb816e7a34f61ae53eea5e674a21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b73eeb-a980-446f-aafd-961a848c1558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b73eeb-a980-446f-aafd-961a848c1558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2baee432-00d4-484f-8bfe-bb60d38eae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2baee432-00d4-484f-8bfe-bb60d38eae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0', 'volume_name': 'volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698934d5-27e2-4778-ba3a-e68ee03afebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (698934d5-27e2-4778-ba3a-e68ee03afebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71399abe-a3e9-4fd8-b144-f3a01fcc98b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:25 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Volume 7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0', 'volume_size': 1} Jun 23 04:43:25 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-353227206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8261ee048f94384bad29412f715f4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:26Z,use_quota=True,user_id='b18cb816e7a34f61ae53eea5e674a21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Creating volume 7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:26 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:26 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 1073741824 Jun 23 04:43:26 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (b0e94641-74df-432a-ba0f-3e1672f76136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d270060-1fb0-4c87-a17d-5e79061271ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d270060-1fb0-4c87-a17d-5e79061271ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34257338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d26079-df87-40e1-87a5-9d839b90faa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:26Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07e3048-6302-443f-b150-b85ddfa284fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b07e3048-6302-443f-b150-b85ddfa284fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3855edc8-dbbb-48c7-a0c4-58cf2c620788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3855edc8-dbbb-48c7-a0c4-58cf2c620788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d26079-df87-40e1-87a5-9d839b90faa3', 'volume_name': 'volume-d2d26079-df87-40e1-87a5-9d839b90faa3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabb4205-c0dc-4e8a-aa7c-6fd8e1934fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabb4205-c0dc-4e8a-aa7c-6fd8e1934fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfd7042-c3f8-4397-9809-e18eb917a4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:26 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume d2d26079-df87-40e1-87a5-9d839b90faa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d26079-df87-40e1-87a5-9d839b90faa3', 'volume_size': 1} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Created reservations ['488b8bf4-260b-480a-8efd-0c8e8f31002a', '3cc7a8b1-2718-456b-843b-341e4d2f4b35', '53ed83d3-4dfc-463b-97e8-41541c3640cd', 'a20d43d7-7340-4791-bb1b-28d5607d8b56'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:26 devstack sudo[113926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:26 devstack sudo[113926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:26 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD" returned: 1 in 0.814s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] f10f43a4-c557-4eee-9a0b-087936c9e2e8 was raw, converting to raw {{(pid=93326) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:26 devstack sudo[113928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:26 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:26 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 1073741824" returned: 0 in 0.912s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:26 devstack sudo[113926]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.716s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:26 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Deleted volume successfully. Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:26 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c7dc621b-2ca8-463d-8f1a-d546e13057d1 tempest-CinderUnicodeTest-1379251442 None] Lock "cinder-ca623052-3ef4-4785-a562-2a6505801782-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:27 devstack sudo[113938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:27 devstack sudo[113938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:27 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 0 in 0.800s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f10f43a4-c557-4eee-9a0b-087936c9e2e8_ompuzs74devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:43:27 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Converted 0.00 MB image at 0.00 MB/s Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:27 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 1G Jun 23 04:43:27 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:27 devstack sudo[113938]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 0.671s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] <== create_volume: return (1641ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.647s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.493s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-34257338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d26079-df87-40e1-87a5-9d839b90faa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:26Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating volume d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:27 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71399abe-a3e9-4fd8-b144-f3a01fcc98b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:27 devstack sudo[113945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 1073741824 Jun 23 04:43:27 devstack sudo[113945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa85cc73-eb2f-4af2-9421-70e837a3f403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:27 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Volume volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 (7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0): created successfully Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa85cc73-eb2f-4af2-9421-70e837a3f403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Flow 'volume_create_manager' (12d494f0-2380-4bf5-ab72-643b58ef28bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:27 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cc3ac8aa-afc2-4e74-97aa-712ffb559a93 tempest-VolumeDependencyTests-1346358293 None] Created volume successfully. Jun 23 04:43:27 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 1G" returned: 0 in 0.760s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[0356c85d-29d5-402a-be11-5137341bd24e]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:27 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:28 devstack sudo[113950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:28 devstack sudo[113950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:28 devstack sudo[113945]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 1073741824" returned: 0 in 1.018s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:28 devstack sudo[113958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 Jun 23 04:43:28 devstack sudo[113958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:28 devstack sudo[113950]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 0 in 0.836s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:28 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:28 devstack sudo[113960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:28 devstack sudo[113960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:29 devstack sudo[113958]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3" returned: 0 in 0.740s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.311s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cfd7042-c3f8-4397-9809-e18eb917a4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d26079-df87-40e1-87a5-9d839b90faa3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b14807-69e8-417e-b6dd-739a272fd168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Creating offline snapshot 7a27b609-4dc1-47fe-a735-e40bc5ea0d68 of volume 7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:43:29 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume volume-d2d26079-df87-40e1-87a5-9d839b90faa3 (d2d26079-df87-40e1-87a5-9d839b90faa3): created successfully Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b14807-69e8-417e-b6dd-739a272fd168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (b0e94641-74df-432a-ba0f-3e1672f76136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ea00c6-8d57-4861-a567-8b05e9a2848c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:29 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-dae81867-62e2-4c78-8ee6-7bf951e5e6c4 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created volume successfully. Jun 23 04:43:29 devstack sudo[113966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:29 devstack sudo[113966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:29 devstack sudo[113960]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 1 in 0.898s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Downloaded image f10f43a4-c557-4eee-9a0b-087936c9e2e8 ((None, [{'url': 'file:///opt/stack/data/glance/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'metadata': {}}])) to volume 0aae40cd-0438-4dbe-8e95-17e75dad3e63 successfully. {{(pid=93326) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Temporary image f10f43a4-c557-4eee-9a0b-087936c9e2e8 for user aede65168e7a414c8cd6897588fb4840 is deleted. {{(pid=93326) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.volume_utils [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Marking volume 0aae40cd-0438-4dbe-8e95-17e75dad3e63 as bootable. {{(pid=93326) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Copying metadata from image f10f43a4-c557-4eee-9a0b-087936c9e2e8 to 0aae40cd-0438-4dbe-8e95-17e75dad3e63. {{(pid=93326) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Creating volume glance metadata for volume 0aae40cd-0438-4dbe-8e95-17e75dad3e63 backed by image f10f43a4-c557-4eee-9a0b-087936c9e2e8 with: {'image_id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'eb7dbfa9ea418997cc6d9b2317a58c3a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93326) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75929500-fc38-49aa-b2e8-e10b5127a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63', 'volume_size': 1, 'image_id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'eb7dbfa9ea418997cc6d9b2317a58c3a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '58caaea529884110916b9aaec084b20e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '683b9332e7ba7e020a14cd35900951cbf13b477b52d11b4030c1dd7e33f7d7a077a1c7b213470f24ad5f1445237a13f7f77d6371bff190c0c8d74399215fce3e', 'id': 'f10f43a4-c557-4eee-9a0b-087936c9e2e8', 'created_at': datetime.datetime(2026, 6, 23, 2, 43, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 23, 2, 43, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f10f43a4-c557-4eee-9a0b-087936c9e2e8/file', 'properties': {}}, 'image_service': }' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fe6b3c-5966-40ff-97e7-2fdf63664ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:29 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Volume volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 (0aae40cd-0438-4dbe-8e95-17e75dad3e63): created successfully Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41fe6b3c-5966-40ff-97e7-2fdf63664ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:29 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Flow 'volume_create_manager' (9308c95e-69ae-462c-8cf3-a809a8b25819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:29 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d5fff273-870b-4be5-ae6b-2fbb49a61257 tempest-VolumeImageDependencyTests-585146615 None] Created volume successfully. Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Acquiring lock "cinder-0aae40cd-0438-4dbe-8e95-17e75dad3e63-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Lock "cinder-0aae40cd-0438-4dbe-8e95-17e75dad3e63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Acquiring lock "cinder-quobyte-0aae40cd-0438-4dbe-8e95-17e75dad3e63" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Lock "cinder-quobyte-0aae40cd-0438-4dbe-8e95-17e75dad3e63" acquired by "delete_volume" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:30 devstack sudo[113966]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 0.939s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[210e5331-6775-468d-b806-676bcd0dca7f]: (4, 'raw') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:30 devstack sudo[113974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 1G Jun 23 04:43:30 devstack sudo[113974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:30 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:30 devstack sudo[113975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:30 devstack sudo[113975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:31 devstack sudo[113975]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 0 in 0.889s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:31 devstack sudo[113974]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 1G" returned: 0 in 1.021s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:31 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:31 devstack sudo[113985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 Jun 23 04:43:31 devstack sudo[113985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:31 devstack sudo[113984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:31 devstack sudo[113984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:32 devstack sudo[113984]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 1 in 0.826s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63' failed. Not Retrying. {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:32 devstack sudo[113985]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68" returned: 0 in 0.748s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:32 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 is being set with open permissions: ugo+rw Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:32 devstack sudo[113994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63 Jun 23 04:43:32 devstack sudo[113994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:32 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 Jun 23 04:43:32 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:32 devstack sudo[113994]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-0aae40cd-0438-4dbe-8e95-17e75dad3e63" returned: 0 in 0.729s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:32 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Lock "cinder-quobyte-0aae40cd-0438-4dbe-8e95-17e75dad3e63" released by "delete_volume" :: held 2.548s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:32 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68" returned: 0 in 0.764s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Created reservations ['22aaf8d9-2660-4228-9676-dd307587d7e5', '8ad3a70e-8058-4c4e-9207-970b152f4af5', '467118c4-12d0-429d-8a8e-25ffa1fb6ee6', '7e96c7be-8d22-4d14-a411-72d3f9f1f980'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:33 devstack sudo[114000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info Jun 23 04:43:33 devstack sudo[114000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:33 devstack sudo[114002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:33 devstack sudo[114002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:33 devstack sudo[114000]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info" returned: 0 in 0.864s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:33 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info is being set with open permissions: ugo+rw Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:33 devstack sudo[114006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info Jun 23 04:43:33 devstack sudo[114006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:33 devstack sudo[114002]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.826s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:33 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:33 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Deleted volume successfully. Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b6f1b6e1-88e5-475d-bc20-a6fb6f0a412e tempest-VolumeImageDependencyTests-585146615 None] Lock "cinder-0aae40cd-0438-4dbe-8e95-17e75dad3e63-delete_volume" released by "delete_volume" :: held 3.684s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:34 devstack sudo[114006]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.info" returned: 0 in 0.721s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.189s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.100s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating offline snapshot 3305025c-80f9-4242-84f7-1be7b89a81de of volume d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:43:34 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-9378581d-97fc-4c80-9f31-ad90e8cce62c tempest-VolumeDependencyTests-1346358293 None] Create snapshot completed successfully Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f97de5-1bb4-4859-bb83-2bc9451d5986]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:34 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:34 devstack sudo[114009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 Jun 23 04:43:34 devstack sudo[114009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:35 devstack sudo[114009]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3" returned: 0 in 1.083s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:35 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:35 devstack sudo[114014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de 1G Jun 23 04:43:35 devstack sudo[114014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Flow 'volume_create_manager' (cdb7c999-07be-464b-a3a2-5ecc0273f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e36efb-ad94-4bd1-9d2e-38826b577207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4e36efb-ad94-4bd1-9d2e-38826b577207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1821544975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c656a38-b70d-4d69-aa4d-e1aea9989137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8261ee048f94384bad29412f715f4fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7a27b609-4dc1-47fe-a735-e40bc5ea0d68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:36Z,use_quota=True,user_id='b18cb816e7a34f61ae53eea5e674a21f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f01623-5451-4928-b8c2-a43e42a6d372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f01623-5451-4928-b8c2-a43e42a6d372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6370afe-355d-407e-9b40-290aefa3f490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6370afe-355d-407e-9b40-290aefa3f490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c656a38-b70d-4d69-aa4d-e1aea9989137', 'volume_name': 'volume-3c656a38-b70d-4d69-aa4d-e1aea9989137', 'volume_size': 1, 'snapshot_id': '7a27b609-4dc1-47fe-a735-e40bc5ea0d68'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04d8915-130f-4a65-a1aa-cfa1351db64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04d8915-130f-4a65-a1aa-cfa1351db64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33050ef-ba05-4b15-840c-7dca27b69fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:36 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Volume 3c656a38-b70d-4d69-aa4d-e1aea9989137: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c656a38-b70d-4d69-aa4d-e1aea9989137', 'volume_size': 1, 'snapshot_id': '7a27b609-4dc1-47fe-a735-e40bc5ea0d68'} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:36 devstack sudo[114014]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de 1G" returned: 0 in 1.036s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:36 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d26079-df87-40e1-87a5-9d839b90faa3 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:36 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d26079-df87-40e1-87a5-9d839b90faa3 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de Jun 23 04:43:36 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:37 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2d26079-df87-40e1-87a5-9d839b90faa3 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de" returned: 0 in 0.742s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:37 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de is being set with open permissions: ugo+rw Jun 23 04:43:37 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:37 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de Jun 23 04:43:37 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:38 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de" returned: 0 in 0.655s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:38 devstack sudo[114028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info Jun 23 04:43:38 devstack sudo[114028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:38 devstack sudo[114028]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info" returned: 0 in 0.669s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:38 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info is being set with open permissions: ugo+rw Jun 23 04:43:38 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:39 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info Jun 23 04:43:39 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:39 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.info" returned: 0 in 0.688s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.024s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.307s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-quobyte-7a27b609-4dc1-47fe-a735-e40bc5ea0d68-3c656a38-b70d-4d69-aa4d-e1aea9989137" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7a27b609-4dc1-47fe-a735-e40bc5ea0d68-3c656a38-b70d-4d69-aa4d-e1aea9989137" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Creating volume 3c656a38-b70d-4d69-aa4d-e1aea9989137 from snapshot 7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-quobyte-3c656a38-b70d-4d69-aa4d-e1aea9989137" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:39 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-80a3664a-d480-4be7-a906-6d358e196b18 tempest-CreateVolumesFromSnapshotTest-194985361 None] Create snapshot completed successfully Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-3c656a38-b70d-4d69-aa4d-e1aea9989137" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] snapshot: 7a27b609-4dc1-47fe-a735-e40bc5ea0d68, volume: 3c656a38-b70d-4d69-aa4d-e1aea9989137, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d74237-6e0c-44a1-9c6e-105d590de18a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:39 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:39 devstack sudo[114035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 Jun 23 04:43:39 devstack sudo[114035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=131,cinder:UPDATE=187,cinder:INSERT=56,cinder:DELETE=23 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (32ac0bbb-f9f8-4abd-ab45-c8dc4820540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d021a9-e89c-43db-8bb8-9b0f065cbebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d021a9-e89c-43db-8bb8-9b0f065cbebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887414824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb50a2aa-8728-411b-a763-694b9f94c4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:41Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77479e8-e759-4754-a42d-6af39e07dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f77479e8-e759-4754-a42d-6af39e07dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb633e9b-7a43-49e9-a5af-fdf7d581ee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb633e9b-7a43-49e9-a5af-fdf7d581ee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb50a2aa-8728-411b-a763-694b9f94c4b4', 'volume_name': 'volume-cb50a2aa-8728-411b-a763-694b9f94c4b4', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89612de5-03c8-4f6a-b6f4-1861156ecf1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89612de5-03c8-4f6a-b6f4-1861156ecf1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:40 devstack sudo[114035]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80d5cec-644f-4dc2-a329-0e8beb4679c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:40 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume cb50a2aa-8728-411b-a763-694b9f94c4b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb50a2aa-8728-411b-a763-694b9f94c4b4', 'volume_size': 1} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68" returned: 0 in 0.909s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a9302a-cc82-481d-9de0-9981b815084c]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:40 devstack sudo[114040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:40 devstack sudo[114040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:SELECT=149,cinder:UPDATE=183,cinder:INSERT=47,cinder:DELETE=12 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:43:40 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (b7413c01-44bc-4719-92ae-1640e9d5a9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c100482-1857-4b08-b5b7-9b85fa22af63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c100482-1857-4b08-b5b7-9b85fa22af63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097928417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c9d7ce-4ebb-428c-abab-a137bfa3fb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:41Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d86ade1-dae4-4356-b947-2ff5d9fde007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d86ade1-dae4-4356-b947-2ff5d9fde007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f61502-3c32-4ad3-bf4b-bb610ea4953e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f61502-3c32-4ad3-bf4b-bb610ea4953e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44c9d7ce-4ebb-428c-abab-a137bfa3fb69', 'volume_name': 'volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd0c9d-12f0-49ff-a0cb-1a38750b229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbd0c9d-12f0-49ff-a0cb-1a38750b229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af98e19-58cd-4066-b782-64418c14b012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume 44c9d7ce-4ebb-428c-abab-a137bfa3fb69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69', 'volume_size': 1} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (21f14fe8-f7a3-4bc9-b94b-e16c76c7ca3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315eb192-3b5e-4971-b666-bcbd52334bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315eb192-3b5e-4971-b666-bcbd52334bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-100172163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db339751-25ef-42c2-8266-3f547d0df8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:42Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9844792-5e18-445c-a5e9-310b88d60913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9844792-5e18-445c-a5e9-310b88d60913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3109f5-54d4-425a-b358-eccf328fb4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3109f5-54d4-425a-b358-eccf328fb4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db339751-25ef-42c2-8266-3f547d0df8d3', 'volume_name': 'volume-db339751-25ef-42c2-8266-3f547d0df8d3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf2db1e-611f-4ffd-bdc8-e440cb9606cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf2db1e-611f-4ffd-bdc8-e440cb9606cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d097e08-05a7-4d5c-af77-18696026e108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:41 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume db339751-25ef-42c2-8266-3f547d0df8d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db339751-25ef-42c2-8266-3f547d0df8d3', 'volume_size': 1} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:41 devstack sudo[114040]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 1.242s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:43:41 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:42 devstack sudo[114046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 Jun 23 04:43:42 devstack sudo[114046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (b6b95a3a-ddb9-4b5f-bcaa-5aa329376e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6cad91-f112-449a-b033-53e36ebaa09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6cad91-f112-449a-b033-53e36ebaa09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799116181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a7391f-6d1c-4c60-b025-96f52ed839de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:42Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d74c5f-17e9-45c0-bdff-354c3e2cebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d74c5f-17e9-45c0-bdff-354c3e2cebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f7bf0-5c01-43df-b213-81c21da45254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f6f7bf0-5c01-43df-b213-81c21da45254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a7391f-6d1c-4c60-b025-96f52ed839de', 'volume_name': 'volume-a4a7391f-6d1c-4c60-b025-96f52ed839de', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd99408c-0ceb-4913-a2bd-bd93599c60cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd99408c-0ceb-4913-a2bd-bd93599c60cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f4af66-c747-443c-b72a-476534924d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume a4a7391f-6d1c-4c60-b025-96f52ed839de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a7391f-6d1c-4c60-b025-96f52ed839de', 'volume_size': 1} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (07a25232-de70-4bc7-9a96-d48b20e3b329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd577f2-4e26-4879-9d82-83619eb9d9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fd577f2-4e26-4879-9d82-83619eb9d9c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-90691645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44faf77c-1d61-4956-8a72-6118e48cd0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:43Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3aeabf-118a-4c97-baa0-9ef55fc26330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc3aeabf-118a-4c97-baa0-9ef55fc26330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12437277-d3dd-4b11-a019-0615a3ddd2a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12437277-d3dd-4b11-a019-0615a3ddd2a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44faf77c-1d61-4956-8a72-6118e48cd0ab', 'volume_name': 'volume-44faf77c-1d61-4956-8a72-6118e48cd0ab', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5e31c-bb52-43ce-af6e-af46b9b4e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1d5e31c-bb52-43ce-af6e-af46b9b4e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73025561-1ca3-4228-8a93-e6b21b9d8dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:42 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume 44faf77c-1d61-4956-8a72-6118e48cd0ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44faf77c-1d61-4956-8a72-6118e48cd0ab', 'volume_size': 1} Jun 23 04:43:42 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:47 devstack sudo[114046]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137" returned: 0 in 5.873s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:47 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56ba8e5-c57d-4163-9cea-86debfd2dec3]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:47 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:47 devstack sudo[114066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:47 devstack sudo[114066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:48 devstack sudo[114066]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 0.965s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:48 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:43:48 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Converted 1024.00 MB image at 174.32 MB/s Jun 23 04:43:48 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 is being set with open permissions: ugo+rw Jun 23 04:43:48 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:48 devstack sudo[114072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 Jun 23 04:43:48 devstack sudo[114072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:49 devstack sudo[114072]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137" returned: 0 in 0.643s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-3c656a38-b70d-4d69-aa4d-e1aea9989137" released by "_copy_volume_from_snapshot" :: held 9.739s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7a27b609-4dc1-47fe-a735-e40bc5ea0d68-3c656a38-b70d-4d69-aa4d-e1aea9989137" released by "_create_volume_from_snapshot" :: held 9.777s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.800s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.788s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1887414824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb50a2aa-8728-411b-a763-694b9f94c4b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:41Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating volume cb50a2aa-8728-411b-a763-694b9f94c4b4 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:49 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:49 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 1073741824 Jun 23 04:43:49 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33050ef-ba05-4b15-840c-7dca27b69fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c656a38-b70d-4d69-aa4d-e1aea9989137', 'volume_size': 1, 'snapshot_id': '7a27b609-4dc1-47fe-a735-e40bc5ea0d68'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d5d6e0-5559-4a41-af42-1311e5b549f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:49 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Volume volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 (3c656a38-b70d-4d69-aa4d-e1aea9989137): created successfully Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16d5d6e0-5559-4a41-af42-1311e5b549f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:49 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Flow 'volume_create_manager' (cdb7c999-07be-464b-a3a2-5ecc0273f805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:49 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-4e14126a-41c7-4240-b19d-d75004bbf363 tempest-VolumeDependencyTests-1346358293 None] Created volume successfully. Jun 23 04:43:50 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 1073741824" returned: 0 in 0.950s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:50 devstack sudo[114081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 Jun 23 04:43:50 devstack sudo[114081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-7a27b609-4dc1-47fe-a735-e40bc5ea0d68-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-7a27b609-4dc1-47fe-a735-e40bc5ea0d68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-quobyte-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-quobyte-7a27b609-4dc1-47fe-a735-e40bc5ea0d68" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7a27b609-4dc1-47fe-a735-e40bc5ea0d68" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Deleting offline snapshot 7a27b609-4dc1-47fe-a735-e40bc5ea0d68 of volume 7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] snapshot_file for this snap is: volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59f6a65-5799-4db6-8101-6d8ad040ff79]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:50 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:50 devstack sudo[114083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 Jun 23 04:43:50 devstack sudo[114083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:51 devstack sudo[114081]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4" returned: 0 in 0.649s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.888s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1097928417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44c9d7ce-4ebb-428c-abab-a137bfa3fb69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:41Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating volume 44c9d7ce-4ebb-428c-abab-a137bfa3fb69 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:51 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:51 devstack sudo[114086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 1073741824 Jun 23 04:43:51 devstack sudo[114086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c80d5cec-644f-4dc2-a329-0e8beb4679c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb50a2aa-8728-411b-a763-694b9f94c4b4', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfad44d-3d10-41b1-934c-d7906be5b412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:51 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 (cb50a2aa-8728-411b-a763-694b9f94c4b4): created successfully Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dfad44d-3d10-41b1-934c-d7906be5b412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (32ac0bbb-f9f8-4abd-ab45-c8dc4820540f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:51 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-ec5025c4-d428-4b70-8d44-eaa980088c7a tempest-CreateVolumesFromSnapshotTest-194985361 None] Created volume successfully. Jun 23 04:43:51 devstack sudo[114083]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68" returned: 0 in 0.859s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb4cbf-30f7-4de3-b85f-51f856476825]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:51 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:51 devstack sudo[114095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:51 devstack sudo[114095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:52 devstack sudo[114086]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 1073741824" returned: 0 in 0.896s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:52 devstack sudo[114098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 Jun 23 04:43:52 devstack sudo[114098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:52 devstack sudo[114095]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 0.832s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:52 devstack sudo[114103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 Jun 23 04:43:52 devstack sudo[114103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:52 devstack sudo[114098]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69" returned: 0 in 0.804s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.745s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.112s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-100172163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db339751-25ef-42c2-8266-3f547d0df8d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:42Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating volume db339751-25ef-42c2-8266-3f547d0df8d3 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:52 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af98e19-58cd-4066-b782-64418c14b012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8cc3f0-ac60-40d7-95e2-7a6984196af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:52 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 1073741824 Jun 23 04:43:52 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:52 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 (44c9d7ce-4ebb-428c-abab-a137bfa3fb69): created successfully Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a8cc3f0-ac60-40d7-95e2-7a6984196af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:52 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (b7413c01-44bc-4719-92ae-1640e9d5a9ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:52 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-bc2d89f1-9b8d-424a-9139-8bec3eb134cf tempest-CreateVolumesFromSnapshotTest-194985361 None] Created volume successfully. Jun 23 04:43:53 devstack sudo[114103]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68" returned: 0 in 0.874s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:53 devstack sudo[114112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68 Jun 23 04:43:53 devstack sudo[114112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:53 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 1073741824" returned: 0 in 1.003s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:53 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:53 devstack sudo[114117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 Jun 23 04:43:53 devstack sudo[114117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:54 devstack sudo[114112]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0.7a27b609-4dc1-47fe-a735-e40bc5ea0d68" returned: 0 in 0.709s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7a27b609-4dc1-47fe-a735-e40bc5ea0d68" released by "_delete_snapshot" :: held 3.409s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" released by "delete_snapshot" :: held 3.437s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Created reservations ['0ad606df-bf3b-4412-9110-084f0205a40b', '49d9b76d-d0e0-471f-bb35-72114e793252', '54430fd3-8667-4fea-a123-878aeb5cb9f1', 'cd7b01e8-aa3e-4c75-9ed3-178692cbdd5e'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Delete snapshot completed successfully. Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-b9875ae4-4810-431d-bdc2-95409e7dd162 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-7a27b609-4dc1-47fe-a735-e40bc5ea0d68-delete_snapshot" released by "delete_snapshot" :: held 3.602s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:54 devstack sudo[114117]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3" returned: 0 in 0.712s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.472s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799116181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a7391f-6d1c-4c60-b025-96f52ed839de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:42Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating volume a4a7391f-6d1c-4c60-b025-96f52ed839de {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:54 devstack sudo[114121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:54 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:54 devstack sudo[114121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:54 devstack sudo[114123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de 1073741824 Jun 23 04:43:54 devstack sudo[114123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d097e08-05a7-4d5c-af77-18696026e108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db339751-25ef-42c2-8266-3f547d0df8d3', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd77e18-9961-473c-bd6a-c09d24928510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:54 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume volume-db339751-25ef-42c2-8266-3f547d0df8d3 (db339751-25ef-42c2-8266-3f547d0df8d3): created successfully Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd77e18-9961-473c-bd6a-c09d24928510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:54 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (21f14fe8-f7a3-4bc9-b94b-e16c76c7ca3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:54 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2793fe6d-58b3-4bfc-a6bc-43235a9b0af3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created volume successfully. Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-quobyte-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b8be9-d7d5-4b82-a87d-715778086711]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:55 devstack sudo[114125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:55 devstack sudo[114125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:55 devstack sudo[114121]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 1.002s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG oslo_service.periodic_task [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] Running periodic task VolumeManager._thread_info {{(pid=93326) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread count: 28 {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-51bc8c0f-0947-4bfe-96da-2769883c586b None None] thread info: [<_MainThread(MainThread, started 140112944009344)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93326) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 23 04:43:55 devstack sudo[114123]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de 1073741824" returned: 0 in 1.175s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:55 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:55 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de Jun 23 04:43:55 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:56 devstack sudo[114125]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 1.132s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:56 devstack sudo[114137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0 Jun 23 04:43:56 devstack sudo[114137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:56 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de" returned: 0 in 0.849s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.085s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.033s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-90691645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44faf77c-1d61-4956-8a72-6118e48cd0ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c697f363f5a04c47815397c6f623290e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:43Z,use_quota=True,user_id='95da61b0bc56405f9b01ab34ba8ddf6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Creating volume 44faf77c-1d61-4956-8a72-6118e48cd0ab {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:56 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f4af66-c747-443c-b72a-476534924d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a7391f-6d1c-4c60-b025-96f52ed839de', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:56 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab 1073741824 Jun 23 04:43:56 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78ade99-8010-42a3-959e-fccdb3c3f0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:56 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume volume-a4a7391f-6d1c-4c60-b025-96f52ed839de (a4a7391f-6d1c-4c60-b025-96f52ed839de): created successfully Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a78ade99-8010-42a3-959e-fccdb3c3f0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:56 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (b6b95a3a-ddb9-4b5f-bcaa-5aa329376e9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:56 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-7357998f-6176-4ce2-b2bd-bed90e6d6b85 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created volume successfully. Jun 23 04:43:57 devstack sudo[114137]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" returned: 0 in 0.711s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0" released by "delete_volume" :: held 1.948s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Created reservations ['09a652e8-ec49-4451-85c8-f6e667811217', '368e5d60-20b3-45ae-9be9-ff0edd293f48', '0de8e08e-d696-4fd4-9868-5d5217e77784', 'ecdda2c5-158a-4f14-9f63-47d32e26a97a'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:57 devstack sudo[114143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:57 devstack sudo[114143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-3c656a38-b70d-4d69-aa4d-e1aea9989137-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-3c656a38-b70d-4d69-aa4d-e1aea9989137-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Flow 'volume_create_manager' (05fe2de3-8eaa-4be0-bc58-827aedd36904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e77d41-a163-4053-940f-10b2fbb60256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e77d41-a163-4053-940f-10b2fbb60256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-782257928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1b13b8-5f09-4f24-bd62-fa38878ce695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8d04da3ee242da8af8df38be3a963d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:57Z,use_quota=True,user_id='35822a3ee4134455a944c4199c85a91f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572d228c-773b-40e6-b790-e3ddea49502b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572d228c-773b-40e6-b790-e3ddea49502b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b554d2be-425f-4c80-9e4a-d6fdb51d533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b554d2be-425f-4c80-9e4a-d6fdb51d533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e1b13b8-5f09-4f24-bd62-fa38878ce695', 'volume_name': 'volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb3835c-5f63-43bd-9176-a10b442145be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bb3835c-5f63-43bd-9176-a10b442145be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaaf72c-1d40-4785-b222-3700c0bee810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:57 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Volume 1e1b13b8-5f09-4f24-bd62-fa38878ce695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695', 'volume_size': 1} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "cinder-quobyte-3c656a38-b70d-4d69-aa4d-e1aea9989137" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-3c656a38-b70d-4d69-aa4d-e1aea9989137" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf842859-1327-47ed-8f73-df90341fb462]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:57 devstack sudo[114149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 Jun 23 04:43:57 devstack sudo[114149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:57 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab 1073741824" returned: 0 in 0.945s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:57 devstack sudo[114151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab Jun 23 04:43:57 devstack sudo[114151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:57 devstack sudo[114143]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:57 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:43:58 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Deleted volume successfully. Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-6cfa7c7e-49f1-4b42-b520-6561c587109f tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-7cefad92-d06f-4bcd-b8b6-ffb44fd95fb0-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:58 devstack sudo[114149]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137" returned: 0 in 0.815s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:58 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137 Jun 23 04:43:58 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:58 devstack sudo[114151]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab" returned: 0 in 0.715s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-782257928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e1b13b8-5f09-4f24-bd62-fa38878ce695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8d04da3ee242da8af8df38be3a963d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:43:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:43:57Z,use_quota=True,user_id='35822a3ee4134455a944c4199c85a91f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)}" {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Creating volume 1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:43:58 devstack cinder-volume[93326]: INFO cinder.volume.drivers.remotefs [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] casted to osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 1073741824 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73025561-1ca3-4228-8a93-e6b21b9d8dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44faf77c-1d61-4956-8a72-6118e48cd0ab', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf3147d-219d-4d66-9b2f-f7f2fbe85a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:43:58 devstack sudo[114160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 1073741824 Jun 23 04:43:58 devstack sudo[114160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:58 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Volume volume-44faf77c-1d61-4956-8a72-6118e48cd0ab (44faf77c-1d61-4956-8a72-6118e48cd0ab): created successfully Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf3147d-219d-4d66-9b2f-f7f2fbe85a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:43:58 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Flow 'volume_create_manager' (07a25232-de70-4bc7-9a96-d48b20e3b329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:43:58 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-a7e9361e-3c3a-4d12-b433-36d6593cb3b3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created volume successfully. Jun 23 04:43:59 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-3c656a38-b70d-4d69-aa4d-e1aea9989137" returned: 0 in 0.677s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-quobyte-3c656a38-b70d-4d69-aa4d-e1aea9989137" released by "delete_volume" :: held 1.537s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Created reservations ['e1e4df39-bf34-47de-b1dc-6ceb93104a42', 'a4c00c5b-ed70-4d72-9b2e-29f5e49a1c94', 'ab7fe585-d8bb-4075-97d3-3cd76a6e15d4', '3a9f87c1-2588-4091-b8b4-3102ff24515b'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:59 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:43:59 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:59 devstack sudo[114160]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 1073741824" returned: 0 in 0.865s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:59 devstack sudo[114170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:43:59 devstack sudo[114170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-44faf77c-1d61-4956-8a72-6118e48cd0ab-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-44faf77c-1d61-4956-8a72-6118e48cd0ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-44faf77c-1d61-4956-8a72-6118e48cd0ab" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-44faf77c-1d61-4956-8a72-6118e48cd0ab" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb1a26c-b8e1-4852-b1f2-c971b04e40d1]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:43:59 devstack sudo[114172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab Jun 23 04:43:59 devstack sudo[114172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:43:59 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.805s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:43:59 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Deleted volume successfully. Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6f3ce61-c2f4-4db6-a6b9-e9b7bde7bc50 tempest-VolumeDependencyTests-1346358293 None] Lock "cinder-3c656a38-b70d-4d69-aa4d-e1aea9989137-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:00 devstack sudo[114170]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.759s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'} {{(pid=93326) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eaaf72c-1d40-4785-b222-3700c0bee810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695', 'volume_size': 1}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48af4188-c3e3-4c4b-bf48-321ccf84db63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:00 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Volume volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 (1e1b13b8-5f09-4f24-bd62-fa38878ce695): created successfully Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48af4188-c3e3-4c4b-bf48-321ccf84db63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Flow 'volume_create_manager' (05fe2de3-8eaa-4be0-bc58-827aedd36904) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:44:00 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-d246daf3-7f6c-4a34-937e-82db38eaeddd tempest-SnapshotDependencyTests-1980552817 None] Created volume successfully. Jun 23 04:44:00 devstack sudo[114172]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab" returned: 0 in 0.895s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:00 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab Jun 23 04:44:00 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Creating offline snapshot 14c89d39-3df0-4f97-957d-4f286c6ef679 of volume 1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b69a34-769a-4260-9b28-61e8573144ba]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:00 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:01 devstack sudo[114181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:44:01 devstack sudo[114181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:01 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44faf77c-1d61-4956-8a72-6118e48cd0ab" returned: 0 in 0.745s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-44faf77c-1d61-4956-8a72-6118e48cd0ab" released by "delete_volume" :: held 1.694s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['3831fed2-392e-473b-a2e7-73bf4693014d', '2ccd0790-7773-449b-8441-56c4597114b6', '9ebe08f9-08da-474b-9ffd-6a2e82d35eea', '109eff73-66b9-4258-8045-2d0d0d7b0663'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:01 devstack sudo[114184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:01 devstack sudo[114184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-a4a7391f-6d1c-4c60-b025-96f52ed839de-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-a4a7391f-6d1c-4c60-b025-96f52ed839de-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-a4a7391f-6d1c-4c60-b025-96f52ed839de" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:01 devstack sudo[114181]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.940s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 1G {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-a4a7391f-6d1c-4c60-b025-96f52ed839de" acquired by "delete_volume" :: waited 0.035s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:01 devstack sudo[114189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 1G Jun 23 04:44:01 devstack sudo[114189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[772987ff-1bb0-4c02-8331-852baeb64c9f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:01 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:01 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de Jun 23 04:44:01 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:02 devstack sudo[114184]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.756s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:02 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleted volume successfully. Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c9dd52f1-2f17-4bba-8288-d35f40f495af tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-44faf77c-1d61-4956-8a72-6118e48cd0ab-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:02 devstack sudo[114189]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 1G" returned: 0 in 0.795s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:02 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de" returned: 0 in 0.761s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:02 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:02 devstack sudo[114201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 Jun 23 04:44:02 devstack sudo[114201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:02 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de Jun 23 04:44:02 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:03 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-a4a7391f-6d1c-4c60-b025-96f52ed839de" returned: 0 in 0.633s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-a4a7391f-6d1c-4c60-b025-96f52ed839de" released by "delete_volume" :: held 1.446s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:03 devstack sudo[114201]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 -F qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679" returned: 0 in 0.697s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:03 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 is being set with open permissions: ugo+rw Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:03 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 Jun 23 04:44:03 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['632fe958-879f-4957-b910-39318803f6e1', '7f4f65c0-678f-4008-aad8-2bdb59db2471', 'd12ac313-9927-4ae5-bbc3-eb0908eee5ac', 'bd3edd56-af4b-4ece-aa33-df4ed3259b81'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:03 devstack sudo[114211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:03 devstack sudo[114211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-db339751-25ef-42c2-8266-3f547d0df8d3-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:03 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-db339751-25ef-42c2-8266-3f547d0df8d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:03 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679" returned: 0 in 0.695s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:04 devstack sudo[114211]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-db339751-25ef-42c2-8266-3f547d0df8d3" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.663s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:04 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info Jun 23 04:44:04 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleted volume successfully. Jun 23 04:44:04 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-db339751-25ef-42c2-8266-3f547d0df8d3" acquired by "delete_volume" :: waited 0.022s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-95e49010-4ce4-453a-a9d1-1e3ff706b1fe tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-a4a7391f-6d1c-4c60-b025-96f52ed839de-delete_volume" released by "delete_volume" :: held 2.371s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f176431-c5f7-4c6c-8b6f-59985897183d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:04 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 Jun 23 04:44:04 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:04 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info" returned: 0 in 0.654s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:04 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info is being set with open permissions: ugo+rw Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:04 devstack sudo[114234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info Jun 23 04:44:04 devstack sudo[114234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:04 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3" returned: 0 in 0.777s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:04 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:04 devstack sudo[114259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3 Jun 23 04:44:04 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:05 devstack sudo[114234]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.info" returned: 0 in 0.705s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:05 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-2ce96a17-55c0-4996-a334-62bc12de2c96 tempest-SnapshotDependencyTests-1980552817 None] Create snapshot completed successfully Jun 23 04:44:05 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-db339751-25ef-42c2-8266-3f547d0df8d3" returned: 0 in 0.662s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-db339751-25ef-42c2-8266-3f547d0df8d3" released by "delete_volume" :: held 1.486s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['3615beb1-dc8d-483e-bd69-d0165c531c77', '7be7ee13-0a18-4194-a11c-4d8cf2059eb7', 'db88d4ae-bc6a-4f97-bcd3-436dc81b40b2', '56591eef-45ad-46c3-b3cd-c68820f21596'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:05 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:05 devstack sudo[114265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:05 devstack sudo[114265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-44c9d7ce-4ebb-428c-abab-a137bfa3fb69-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-44c9d7ce-4ebb-428c-abab-a137bfa3fb69-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-44c9d7ce-4ebb-428c-abab-a137bfa3fb69" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-44c9d7ce-4ebb-428c-abab-a137bfa3fb69" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[669b46d0-947d-4dfa-8479-8c6705a50c04]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:06 devstack sudo[114265]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.684s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:06 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleted volume successfully. Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-1a6b0e59-a87d-4c18-85cd-4251b1534a1a tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-db339751-25ef-42c2-8266-3f547d0df8d3-delete_volume" released by "delete_volume" :: held 2.406s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:06 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 Jun 23 04:44:06 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93326) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Flow 'volume_create_manager' (32356e30-7207-4504-a45b-e24d77454c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e011eac4-290b-4f57-a950-28dff4d980c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e011eac4-290b-4f57-a950-28dff4d980c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-23T02:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f45491-e15e-413c-8f4a-50618ad0e18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df8d04da3ee242da8af8df38be3a963d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-23T02:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=14c89d39-3df0-4f97-957d-4f286c6ef679,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-23T02:44:07Z,use_quota=True,user_id='35822a3ee4134455a944c4199c85a91f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c3457fb9-3f4c-436e-9921-b7362fe90947),volume_type_id=c3457fb9-3f4c-436e-9921-b7362fe90947)' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a646dfb-efa1-4581-8c7d-5c82dbb4ad85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a646dfb-efa1-4581-8c7d-5c82dbb4ad85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e3efcc-f279-4a2a-90ae-7d21c44f16b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09e3efcc-f279-4a2a-90ae-7d21c44f16b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08f45491-e15e-413c-8f4a-50618ad0e18f', 'volume_name': 'volume-08f45491-e15e-413c-8f4a-50618ad0e18f', 'volume_size': 1, 'snapshot_id': '14c89d39-3df0-4f97-957d-4f286c6ef679'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a70422b-08ca-4e27-9da4-696e7dbd278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a70422b-08ca-4e27-9da4-696e7dbd278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f06ad8-983c-40f9-a316-15d16c7fa53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:06 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Volume 08f45491-e15e-413c-8f4a-50618ad0e18f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08f45491-e15e-413c-8f4a-50618ad0e18f', 'volume_size': 1, 'snapshot_id': '14c89d39-3df0-4f97-957d-4f286c6ef679'} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-quobyte-14c89d39-3df0-4f97-957d-4f286c6ef679-08f45491-e15e-413c-8f4a-50618ad0e18f" by "_create_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-14c89d39-3df0-4f97-957d-4f286c6ef679-08f45491-e15e-413c-8f4a-50618ad0e18f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Creating volume 08f45491-e15e-413c-8f4a-50618ad0e18f from snapshot 14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Selected osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77 as target Quobyte volume. {{(pid=93326) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-quobyte-08f45491-e15e-413c-8f4a-50618ad0e18f" by "_copy_volume_from_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-08f45491-e15e-413c-8f4a-50618ad0e18f" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] snapshot: 14c89d39-3df0-4f97-957d-4f286c6ef679, volume: 08f45491-e15e-413c-8f4a-50618ad0e18f, {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29ed9ef-fe11-4d11-9bf8-0e0ac85589c1]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:06 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:07 devstack sudo[114270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 Jun 23 04:44:07 devstack sudo[114270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:07 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69" returned: 0 in 0.817s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:07 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69 Jun 23 04:44:07 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:07 devstack sudo[114270]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679" returned: 0 in 0.787s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] will copy from snapshot at /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Creating direct copy from snapshot {{(pid=93326) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2a3cae-9ef2-4d1a-b5e9-0bdfd5ef4ef4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:07 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-44c9d7ce-4ebb-428c-abab-a137bfa3fb69" returned: 0 in 0.651s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-44c9d7ce-4ebb-428c-abab-a137bfa3fb69" released by "delete_volume" :: held 1.515s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:07 devstack sudo[114281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:44:07 devstack sudo[114281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['15438805-d79d-4a2c-bb8c-14f7ea2e5b0b', '5864657d-fd50-4da5-afdc-544785b84032', 'ba6367e8-d43e-4b62-b50d-220776e7f063', '91e1d03b-2c16-43fe-b882-b4bf66c28d03'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:07 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:07 devstack sudo[114283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:07 devstack sudo[114283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:08 devstack sudo[114281]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.741s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.utils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Path /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f not found in is_blk_device check {{(pid=93326) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-cb50a2aa-8728-411b-a763-694b9f94c4b4-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:08 devstack sudo[114289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f Jun 23 04:44:08 devstack sudo[114289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-cb50a2aa-8728-411b-a763-694b9f94c4b4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-cb50a2aa-8728-411b-a763-694b9f94c4b4" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-cb50a2aa-8728-411b-a763-694b9f94c4b4" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:08 devstack sudo[114283]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.652s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:08 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleted volume successfully. Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb5c382-2307-41a7-b227-c805224e9a38]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:08 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-5584fed6-cdd4-4927-977e-eca702ecb769 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-44c9d7ce-4ebb-428c-abab-a137bfa3fb69-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:08 devstack sudo[114291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 Jun 23 04:44:08 devstack sudo[114291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:09 devstack sudo[114291]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4" returned: 0 in 0.897s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:09 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:09 devstack sudo[114307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4 Jun 23 04:44:09 devstack sudo[114307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:10 devstack sudo[114307]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:10 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-cb50a2aa-8728-411b-a763-694b9f94c4b4" returned: 0 in 1.446s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:10 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-cb50a2aa-8728-411b-a763-694b9f94c4b4" released by "delete_volume" :: held 2.435s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['a22deaf4-c12a-4273-aa39-a0b88f25e41d', 'ec9a7fc5-6f6f-46e5-a0e4-18fb9bc8bc24', '38291604-ae48-40d4-b1cc-6e743b6b707f', 'f1a50f0e-ecf2-4a79-86f4-e63cbe2bda7c'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:11 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:11 devstack sudo[114311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:11 devstack sudo[114311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-3305025c-80f9-4242-84f7-1be7b89a81de-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-3305025c-80f9-4242-84f7-1be7b89a81de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-d2d26079-df87-40e1-87a5-9d839b90faa3" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-d2d26079-df87-40e1-87a5-9d839b90faa3" acquired by "delete_snapshot" :: waited 0.055s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-3305025c-80f9-4242-84f7-1be7b89a81de" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-3305025c-80f9-4242-84f7-1be7b89a81de" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleting offline snapshot 3305025c-80f9-4242-84f7-1be7b89a81de of volume d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] snapshot_file for this snap is: volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ea5ef-ac04-401c-a8e3-9dd6394cee1a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:12 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:12 devstack sudo[114313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de Jun 23 04:44:12 devstack sudo[114313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:13 devstack sudo[114311]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 2.289s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:13 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleted volume successfully. Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-200d3ed5-fa03-4a97-a9a0-abf8c1f96de3 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-cb50a2aa-8728-411b-a763-694b9f94c4b4-delete_volume" released by "delete_volume" :: held 5.116s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:13 devstack sudo[114289]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f" returned: 0 in 5.190s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7edf62-fa20-4e1e-a335-87fd8223df0f]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:13 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:44:13 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:13 devstack sudo[114313]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de" returned: 0 in 1.473s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2d26079-df87-40e1-87a5-9d839b90faa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d4f772-ae83-47e2-8434-b9b38d16af9d]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:13 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:14 devstack sudo[114321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 Jun 23 04:44:14 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:14 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.971s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:14 devstack cinder-volume[93326]: DEBUG cinder.image.image_utils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Image conversion details: src /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f {{(pid=93326) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 23 04:44:14 devstack cinder-volume[93326]: INFO cinder.image.image_utils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Converted 1024.00 MB image at 197.28 MB/s Jun 23 04:44:14 devstack cinder-volume[93326]: WARNING cinder.volume.drivers.remotefs [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f is being set with open permissions: ugo+rw Jun 23 04:44:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:14 devstack sudo[114329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f Jun 23 04:44:14 devstack sudo[114329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:14 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3" returned: 0 in 0.756s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:14 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:14 devstack sudo[114331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de Jun 23 04:44:14 devstack sudo[114331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:15 devstack sudo[114329]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f" returned: 0 in 0.631s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-08f45491-e15e-413c-8f4a-50618ad0e18f" released by "_copy_volume_from_snapshot" :: held 8.426s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-14c89d39-3df0-4f97-957d-4f286c6ef679-08f45491-e15e-413c-8f4a-50618ad0e18f" released by "_create_volume_from_snapshot" :: held 8.461s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.480s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f06ad8-983c-40f9-a316-15d16c7fa53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f45491-e15e-413c-8f4a-50618ad0e18f', 'volume_size': 1, 'snapshot_id': '14c89d39-3df0-4f97-957d-4f286c6ef679'}' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72131892-b67e-4373-b2a5-42416f19b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 23 04:44:15 devstack cinder-volume[93326]: INFO cinder.volume.flows.manager.create_volume [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Volume volume-08f45491-e15e-413c-8f4a-50618ad0e18f (08f45491-e15e-413c-8f4a-50618ad0e18f): created successfully Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72131892-b67e-4373-b2a5-42416f19b131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93326) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Flow 'volume_create_manager' (32356e30-7207-4504-a45b-e24d77454c82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93326) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 23 04:44:15 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-dd9cb702-3f58-4df5-9f5d-dbbc21b729a2 tempest-SnapshotDependencyTests-1980552817 None] Created volume successfully. Jun 23 04:44:15 devstack sudo[114331]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de" returned: 0 in 0.758s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:15 devstack sudo[114338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de Jun 23 04:44:15 devstack sudo[114338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-14c89d39-3df0-4f97-957d-4f286c6ef679-delete_snapshot" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-14c89d39-3df0-4f97-957d-4f286c6ef679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-quobyte-1e1b13b8-5f09-4f24-bd62-fa38878ce695" by "delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-1e1b13b8-5f09-4f24-bd62-fa38878ce695" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-quobyte-14c89d39-3df0-4f97-957d-4f286c6ef679" by "_delete_snapshot" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-14c89d39-3df0-4f97-957d-4f286c6ef679" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Deleting offline snapshot 14c89d39-3df0-4f97-957d-4f286c6ef679 of volume 1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] snapshot_file for this snap is: volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed6c2f1-d679-4200-ab17-7d23896b1645]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:15 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:15 devstack sudo[114340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 Jun 23 04:44:15 devstack sudo[114340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:16 devstack sudo[114338]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3.3305025c-80f9-4242-84f7-1be7b89a81de" returned: 0 in 0.657s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-3305025c-80f9-4242-84f7-1be7b89a81de" released by "_delete_snapshot" :: held 3.796s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-d2d26079-df87-40e1-87a5-9d839b90faa3" released by "delete_snapshot" :: held 3.847s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['e0d8dd4d-39ad-47fe-9376-9c38cbf4833d', 'e4251b7e-4658-4b3a-bdb2-7aa531511ec7', 'e88d8092-fe7e-4a6c-beb9-d4f3a58ea891', 'e1e21e99-a607-435d-9985-8b03c6993b3d'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:16 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Delete snapshot completed successfully. Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-f746bff6-11c3-4791-8e78-05465fccd0a6 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-3305025c-80f9-4242-84f7-1be7b89a81de-delete_snapshot" released by "delete_snapshot" :: held 4.022s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:16 devstack sudo[114340]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679" returned: 0 in 0.778s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.remotefs [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93326) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c25bd2-bc3b-4d1e-b94b-07240f33f54a]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:16 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:44:16 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-d2d26079-df87-40e1-87a5-9d839b90faa3-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-d2d26079-df87-40e1-87a5-9d839b90faa3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "cinder-quobyte-d2d26079-df87-40e1-87a5-9d839b90faa3" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-d2d26079-df87-40e1-87a5-9d839b90faa3" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa726ff-054c-430c-ab4e-ed06045e0949]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:16 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:16 devstack sudo[114348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 Jun 23 04:44:16 devstack sudo[114348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:17 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.744s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:17 devstack sudo[114353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 Jun 23 04:44:17 devstack sudo[114353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:17 devstack sudo[114348]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3" returned: 0 in 0.770s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:17 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3 Jun 23 04:44:17 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:17 devstack sudo[114353]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679" returned: 0 in 0.781s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:17 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:17 devstack sudo[114363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679 Jun 23 04:44:17 devstack sudo[114363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:18 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-d2d26079-df87-40e1-87a5-9d839b90faa3" returned: 0 in 0.682s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-quobyte-d2d26079-df87-40e1-87a5-9d839b90faa3" released by "delete_volume" :: held 1.515s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Created reservations ['ef2c87c2-7917-4089-a08e-14874684ff8c', '7ae46fad-9f66-4620-b941-6cb6c184e6b7', '23b061fc-9910-412f-bfba-c7843a73b1c5', '368c9c47-2ad7-41dd-b849-27718129d477'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:18 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:18 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:18 devstack sudo[114363]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695.14c89d39-3df0-4f97-957d-4f286c6ef679" returned: 0 in 0.665s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-14c89d39-3df0-4f97-957d-4f286c6ef679" released by "_delete_snapshot" :: held 3.068s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-1e1b13b8-5f09-4f24-bd62-fa38878ce695" released by "delete_snapshot" :: held 3.094s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Created reservations ['31dab633-0eb4-41cf-88c9-6657cbabb2ad', '417539df-44b0-4ef0-9d86-189538822abd', 'f4254236-e90c-4972-a41d-64e40e23972b', '23254bc5-a71f-4d11-b05c-e23f5d8d305c'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Delete snapshot completed successfully. Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-c6932fe7-837d-491f-928c-08131c7df98a tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-14c89d39-3df0-4f97-957d-4f286c6ef679-delete_snapshot" released by "delete_snapshot" :: held 3.267s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:18 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.679s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:18 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Deleted volume successfully. Jun 23 04:44:18 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-97d2a2fd-f3b9-422b-9260-2a9d6a15c638 tempest-CreateVolumesFromSnapshotTest-194985361 None] Lock "cinder-d2d26079-df87-40e1-87a5-9d839b90faa3-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-1e1b13b8-5f09-4f24-bd62-fa38878ce695-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-1e1b13b8-5f09-4f24-bd62-fa38878ce695-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-quobyte-1e1b13b8-5f09-4f24-bd62-fa38878ce695" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:19 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-1e1b13b8-5f09-4f24-bd62-fa38878ce695" acquired by "delete_volume" :: waited 0.018s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:19 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[38238e37-f919-42a4-bb3e-5074a62469c4]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:19 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:20 devstack sudo[114372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:44:20 devstack sudo[114372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:20 devstack sudo[114372]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.772s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:20 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:20 devstack sudo[114377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695 Jun 23 04:44:20 devstack sudo[114377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:21 devstack sudo[114377]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-1e1b13b8-5f09-4f24-bd62-fa38878ce695" returned: 0 in 0.653s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-1e1b13b8-5f09-4f24-bd62-fa38878ce695" released by "delete_volume" :: held 1.535s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Created reservations ['3ff5b9f3-22b1-4665-b425-0085785f7d4a', 'ee584443-1454-4e89-a052-13fa5a0455fd', '34b02b20-d074-46e6-88f9-bec143678141', 'bbc3e599-3daa-41e0-80db-b95e2cae7e14'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:21 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:21 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:21 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-08f45491-e15e-413c-8f4a-50618ad0e18f-delete_volume" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-08f45491-e15e-413c-8f4a-50618ad0e18f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "cinder-quobyte-08f45491-e15e-413c-8f4a-50618ad0e18f" by "delete_volume" {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-08f45491-e15e-413c-8f4a-50618ad0e18f" acquired by "delete_volume" :: waited 0.019s {{(pid=93326) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c2c94a-4020-4e2f-bc57-7bff75dd8130]: (4, 'qcow2') {{(pid=94617) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:22 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.661s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:22 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Deleted volume successfully. Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-cd5ad4ba-e7bd-4382-96c7-c35e6cfaa6a6 tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-1e1b13b8-5f09-4f24-bd62-fa38878ce695-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:22 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f Jun 23 04:44:22 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:22 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f" returned: 0 in 0.765s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:22 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:22 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f Jun 23 04:44:22 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:23 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090/volume-08f45491-e15e-413c-8f4a-50618ad0e18f" returned: 0 in 0.641s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-quobyte-08f45491-e15e-413c-8f4a-50618ad0e18f" released by "delete_volume" :: held 1.446s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG cinder.quota [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Created reservations ['9cfbe3f6-7cb4-429d-9a06-0734209b3121', '6abbb37f-d8b9-4698-9253-2e6a6ce9bcbd', '49eb4791-d23f-40ca-9826-f79ba949fd7c', '60802610-ae66-44e0-bc50-5988e260fc55'] {{(pid=93326) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77': None} {{(pid=93326) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG cinder.volume.drivers.quobyte [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-1978e060-91f0-4a63-86ac-b262c6dd3d77'] {{(pid=93326) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.lockutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93326) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 23 04:44:23 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 23 04:44:23 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090 Jun 23 04:44:23 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 23 04:44:24 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Jun 23 04:44:24 devstack cinder-volume[93326]: DEBUG oslo_concurrency.processutils [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/67221b93f8ce36e4761b25afbd140090" returned: 0 in 0.662s {{(pid=93326) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 23 04:44:24 devstack cinder-volume[93326]: DEBUG cinder.manager [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Notifying Schedulers of capabilities ... {{(pid=93326) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 23 04:44:24 devstack cinder-volume[93326]: INFO cinder.volume.manager [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Deleted volume successfully. Jun 23 04:44:24 devstack cinder-volume[93326]: DEBUG cinder.coordination [None req-de918027-7b1d-4758-83dc-70e894c3040f tempest-SnapshotDependencyTests-1980552817 None] Lock "cinder-08f45491-e15e-413c-8f4a-50618ad0e18f-delete_volume" released by "delete_volume" :: held 2.301s {{(pid=93326) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 23 04:44:33 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=133,cinder:SELECT=74,cinder:DELETE=10,cinder:INSERT=26 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 23 04:44:34 devstack cinder-volume[93326]: DEBUG dbcounter [-] [93326] Writing DB stats cinder:UPDATE=106,cinder:SELECT=94,cinder:DELETE=9,cinder:INSERT=33 {{(pid=93326) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}